-- Logs begin at Thu 2022-10-27 16:52:08 UTC, end at Thu 2022-10-27 17:57:46 UTC. -- Oct 27 17:21:46.825095 dv-cinder-862831-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 17:21:46.833854 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 17:21:46.835987 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 17:21:46 2022] *** Oct 27 17:21:46.835987 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 17:21:46.835987 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 17:21:46.835987 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: nodename: dv-cinder-862831-1-iscsi Oct 27 17:21:46.835987 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: machine: x86_64 Oct 27 17:21:46.835987 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: clock source: unix Oct 27 17:21:46.835987 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: pcre jit disabled Oct 27 17:21:46.835987 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: detected number of CPU cores: 4 Oct 27 17:21:46.835987 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: current working directory: / Oct 27 17:21:46.835987 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: detected binary path: /usr/bin/uwsgi-core Oct 27 17:21:46.836672 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: your processes number limit is 47680 Oct 27 17:21:46.836672 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: your memory page size is 4096 bytes Oct 27 17:21:46.836672 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: detected max file descriptor number: 2048 Oct 27 17:21:46.836672 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: lock engine: pthread robust mutexes Oct 27 17:21:46.836672 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: thunder lock: enabled Oct 27 17:21:46.836672 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 17:21:46.836672 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 17:21:46.875394 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: Python main interpreter initialized at 0x5580705b49c0 Oct 27 17:21:46.875394 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: python threads support enabled Oct 27 17:21:46.875394 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: your server socket listen backlog is limited to 100 connections Oct 27 17:21:46.875394 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: your mercy for graceful operations on workers is 90 seconds Oct 27 17:21:46.875738 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 17:21:46.875817 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: *** Operational MODE: preforking *** Oct 27 17:21:46.876068 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: *** uWSGI is running in multiple interpreter mode *** Oct 27 17:21:46.876068 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: spawned uWSGI master process (pid: 103796) Oct 27 17:21:46.876242 dv-cinder-862831-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 27 17:21:46.879044 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: spawned uWSGI worker 1 (pid: 103797, cores: 1) Oct 27 17:21:46.879044 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: spawned uWSGI worker 2 (pid: 103798, cores: 1) Oct 27 17:21:46.879044 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 17:21:47.534712 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 17:21:47.538206 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 17:21:48.610131 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 17:21:48.610131 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: from cryptography.utils import int_from_bytes Oct 27 17:21:48.610713 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 17:21:48.610713 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: from cryptography.utils import int_from_bytes Oct 27 17:21:48.610713 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 17:21:48.610713 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: from cryptography.utils import int_from_bytes Oct 27 17:21:48.611225 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 17:21:48.611225 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: from cryptography.utils import int_from_bytes Oct 27 17:21:51.132124 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 17:21:51.132684 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 17:21:51.132898 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 17:21:51.133265 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 17:21:51.133525 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 17:21:51.133912 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.134239 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.134561 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.134881 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.135214 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.135525 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.135933 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.136213 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.136522 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.136782 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.137100 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.137427 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862831-1-iscsi {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.137751 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.138060 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.138371 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.138455 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 17:21:51.138812 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.138893 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 17:21:51.138979 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.139229 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 17:21:51.139323 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.139586 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.139677 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 17:21:51.139866 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 17:21:51.140111 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.140256 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.140557 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.140697 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.140858 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.140966 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.141179 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.141280 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.141519 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.141621 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.141829 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.141929 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.142137 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.142230 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.142457 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.142539 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.142768 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.142861 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.143043 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.143141 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.143362 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.143461 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.143692 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862831-1-iscsi {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.143820 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862831-1-iscsi {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.144050 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.144147 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.144363 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.144471 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.144675 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.144774 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.144998 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.145103 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.145308 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.145400 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.145635 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.145726 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.145943 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.146051 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.146308 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.146451 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.146619 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.146765 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.146976 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.147101 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.147299 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.147415 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.147621 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.147780 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.147968 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.148102 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.148264 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.148415 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.148572 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.148739 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.148882 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.149052 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.149204 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.149380 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.149511 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.149693 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.149815 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.150065 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.150165 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862831-1-iscsi {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.150374 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.150462 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.150696 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.150784 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.151010 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.151102 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.151336 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.151425 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.151588 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.151758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.151861 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.152075 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.152162 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.152401 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.152495 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.152730 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.152818 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.153042 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.153176 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.153362 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.153447 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.153671 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.153758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.153976 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.154062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.154281 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.154367 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.154589 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.154677 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.154894 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.154984 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.155212 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.155304 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.155524 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.155610 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.155858 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.155945 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.156166 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.156260 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.156418 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.156502 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.156729 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.156870 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.157057 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.157151 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.157383 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.157478 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.157710 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.157799 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.157965 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.158053 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.158219 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.158351 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.158545 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.158631 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.158871 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.158967 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.159184 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.159265 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.159494 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.159579 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.159828 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.159920 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.160138 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.160225 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.160449 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.160546 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.160760 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.160864 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.161014 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.161099 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.161318 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.161421 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.161622 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.161716 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.161941 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.162029 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.162248 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.162347 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.162577 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.162670 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.162884 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.162978 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.163184 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.163325 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.163489 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.163584 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.163814 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.163903 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.164122 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.164210 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.164427 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.164516 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.164732 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.164826 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.165036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.165132 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.165342 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.165441 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.165648 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.165742 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.165953 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.166040 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.166258 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.166344 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.166578 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.166664 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.166898 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.166985 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.167204 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.167292 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.167468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.167554 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.167800 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.167907 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.168113 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.168200 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.168431 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.168524 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.168739 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.168831 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.169043 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.169129 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.169351 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.169444 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.169657 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.169744 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.169962 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.170047 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.170269 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.170363 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.170579 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.170666 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.170889 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.170975 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.171198 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.171292 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.171498 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.171585 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.171829 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.171930 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.172143 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.172239 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.172450 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.172544 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.172758 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.172845 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.173064 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.173159 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.173371 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.173466 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.173677 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.173763 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.173984 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.174071 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.174290 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.174384 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.174596 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.174689 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.174895 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.174992 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.175214 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.175302 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.175522 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.175615 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.175858 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.175948 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.176168 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.176256 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.176476 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.176561 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.176795 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.176884 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.177105 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.177191 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.177416 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.177509 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.177742 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.177830 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.178047 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.178619 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.178879 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.178968 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.179205 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.179292 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.179518 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.179604 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.179854 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.179956 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.180167 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.180254 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.180479 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.180565 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.180790 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.180885 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.181102 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.181188 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.181408 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.181493 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.181718 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.181813 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.182023 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.182119 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.182347 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.182434 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.182663 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.182757 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.182977 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.183062 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.183289 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.183382 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.183599 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.183688 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.183943 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.184065 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:21:51.184272 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.184409 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.184595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.184683 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.184904 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.184998 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.185245 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.185346 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.185589 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.185676 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.185902 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.185989 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.186228 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.186318 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.186542 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.186640 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.186851 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.186938 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.187164 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.187261 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.187474 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.187569 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.187813 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.187904 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.188135 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.188235 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.188447 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.188533 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.188767 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.188852 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.189079 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.189177 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.189402 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.189489 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.189715 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.189818 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.190026 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.190122 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.190337 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.190424 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.190649 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.190744 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.190959 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.191059 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.191292 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.191391 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.191608 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.191694 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.191953 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.192052 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.192269 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.192357 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.192581 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.192668 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.192898 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.192986 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.193209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.193296 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.193519 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.193605 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.193910 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.194536 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.194710 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.194800 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.195017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.195104 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.195323 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.195412 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.195633 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.195780 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.195961 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.196049 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.196285 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.196374 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.196614 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.196702 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.196921 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.197020 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.197235 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.197321 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.197548 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.197634 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.197860 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.197955 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.198170 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.198257 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.198482 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.198576 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.198788 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.198883 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.199099 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.199186 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.199409 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.199496 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.199731 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.199839 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.200057 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.200143 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.200367 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.200460 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.200674 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.200764 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.200984 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.201071 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.201288 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.201382 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.201591 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.201678 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.201899 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.201986 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.202208 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.202293 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.202513 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.202607 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.202825 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.202912 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.203136 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.203222 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.203448 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.203535 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.203781 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.203876 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.204093 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.204193 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.204423 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.204509 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.204739 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.204835 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.205042 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.205136 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.205349 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.205435 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.205663 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.205750 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.205977 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.206073 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.206280 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.206373 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.206590 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.206676 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.206896 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.206992 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.207202 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.207326 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.207507 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.207593 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.207846 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.207937 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.208152 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.208240 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.208459 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.208546 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.208764 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.208853 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.209069 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.209157 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.209398 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.209485 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.209718 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.209806 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.210043 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.210129 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.210350 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.210437 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.210655 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.210751 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.210959 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.211046 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.211304 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.211400 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.211612 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.211697 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.211968 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.212068 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.212297 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.212394 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.212615 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.212708 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.212923 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.213009 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.213237 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.213332 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.213546 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.213634 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.213857 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.213951 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.214164 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.214259 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.214474 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.214560 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.214782 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.214874 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.215091 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.215186 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.215400 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.215487 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.215734 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.215823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.216036 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.216126 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.216360 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.216446 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.216672 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.216758 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.216981 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.217069 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.217285 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.217408 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.217590 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.217676 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.217928 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.218016 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.218236 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.218325 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.218569 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.218656 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.218893 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.218982 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.219206 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.219292 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.219521 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.219616 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.219855 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.219946 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.220169 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.220272 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.220480 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.220577 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.220790 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.220877 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.221102 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.221187 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.221415 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.221509 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.221732 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.221820 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.222044 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.222132 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.222363 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.222457 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.222671 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.222757 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.222988 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.223075 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.223292 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.223379 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.223606 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.223700 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.223944 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.224061 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.224264 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.224356 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.224575 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.224660 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.224887 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.225022 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.225232 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.225320 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.225543 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.225629 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.225851 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.225937 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.226163 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.226252 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.226469 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.226564 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.226775 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.226861 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.227085 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.227171 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.227395 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.227495 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.227704 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.227825 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.228032 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.228119 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.228337 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.228422 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.228652 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.228745 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.228960 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.229050 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.229518 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.229604 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.229824 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.229998 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.230135 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.230219 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.230456 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.230541 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.230765 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.230862 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.231090 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.231176 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.231410 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.231494 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.231738 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.231824 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.232038 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.232123 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.232357 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.232440 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.232665 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.232752 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.232970 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.233056 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.233280 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.233373 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.233584 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.233677 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.233910 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.233994 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.234218 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.234312 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.234520 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.234606 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.234836 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.234936 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.235142 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.235243 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.235454 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.235538 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.235788 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.235874 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.236098 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.236194 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.236405 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.236489 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.236719 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.236803 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.237031 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.237129 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.237341 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.237427 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.237652 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.237737 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.237961 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.238055 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.238271 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.238363 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.238576 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.238660 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.238895 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.238981 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.239204 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.239289 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.239510 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.239594 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.239854 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.239952 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.240147 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.240240 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.240454 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.240539 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.241288 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.241377 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.241606 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.241852 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.241937 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.242187 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.242281 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.242504 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.242590 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.242825 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.242918 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.243144 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.243230 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.243459 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.243554 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.243810 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.243901 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.244132 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.244217 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.244445 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.244532 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.244759 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.244898 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.245066 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.245152 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.245372 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.245458 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.245679 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.245773 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.245989 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.246084 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.246296 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.246382 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.246604 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.246689 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.246912 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.247014 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.247218 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.247303 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.247522 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.247607 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.247866 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.247967 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.248159 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.248413 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.248507 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.248752 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.248855 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.249059 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.249144 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.249370 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.249457 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.249676 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.249769 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.250000 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.250096 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.250310 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.250396 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.250613 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.250700 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.250916 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.251003 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.251221 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.251306 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.251564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.251650 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.251900 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.251995 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.252212 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.252297 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.252530 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.252617 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.252842 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.252936 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.253155 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.253241 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.253465 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.253563 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.253781 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.253868 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.254086 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.254171 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.254393 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.254565 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.254694 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.254778 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.255004 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.255089 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.255316 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.255418 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.255620 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.255763 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.255955 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.256051 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.256288 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.256382 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.257111 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.257197 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.257426 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.257512 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.257733 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.257894 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.258046 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.258211 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.258350 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.258522 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.258666 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.258871 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.258964 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.259185 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.259272 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.259532 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.259628 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.259874 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.259972 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.260186 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.260281 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.260491 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.260586 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.260802 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.260890 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.261106 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.261200 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.261423 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.261510 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.261728 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.261820 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.262034 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.262118 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.262335 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.262420 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.262646 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.262730 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.262952 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.263038 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.263254 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.263346 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.263565 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.263649 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.263898 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.263984 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.264207 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.264329 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.264512 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.264597 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.264823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.264918 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.265127 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.265221 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.265433 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.265528 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.265743 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.265847 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.266048 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.266133 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.266356 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.266441 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.266665 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.266762 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.266975 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.267061 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.267279 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.267363 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.267583 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.267676 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.267915 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.268000 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.268224 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.268321 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.268530 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.268616 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.268834 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.268918 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.269135 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.269220 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.269438 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.269532 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.269741 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.269826 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.270045 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.270138 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.270361 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.270455 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.270667 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.270753 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.270971 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.271055 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.271272 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.271357 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.271582 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.271667 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.271941 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.272038 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.272252 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.272338 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.272565 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.272651 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.272894 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.272988 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.273210 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.273294 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.273515 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.273607 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.273823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.273920 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.274128 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.274213 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.274429 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.274512 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.274736 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.274828 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.275044 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.275128 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.275344 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.275437 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.275644 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.275750 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.275974 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.276060 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.276281 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.276366 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.276590 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.276684 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.276900 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.276984 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.277219 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.277310 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.277527 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.277614 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.277836 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.277923 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.278141 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.278235 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.278450 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.278536 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.278760 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.278856 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.279074 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.279169 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.279386 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.279479 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.279697 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.279820 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.280035 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.280183 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.280349 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.280449 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.280660 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.280758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.280971 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.281078 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.281277 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.281372 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.281580 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.281684 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.281894 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.281999 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.282201 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.282296 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.282506 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.282602 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.282813 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.282924 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.283123 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.283218 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.283429 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.283534 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.283756 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.283860 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.284065 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.284152 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.284374 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.284460 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.284679 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.284769 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.285014 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.285098 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.285330 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.285415 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.285646 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.285735 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.285958 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.286043 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.286273 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.286358 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.286584 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.286669 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.286897 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.286981 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.287206 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.287305 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.287534 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.287619 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.287881 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.287979 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.288199 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.288298 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.288507 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.288593 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.288823 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.288916 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.289136 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.289230 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.289444 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.289537 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.289753 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.289837 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.290085 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.290224 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.290365 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.290455 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.290667 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.290754 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.290971 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.291065 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.291280 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.291365 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.291584 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.291668 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.291937 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.292030 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.292347 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.292431 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.292657 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.292741 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.292964 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.293050 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.293277 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.293363 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.293592 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.293677 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.293910 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.294010 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.294226 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.294312 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.294535 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.294629 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.294901 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.295007 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.295208 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.295293 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.295520 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.295653 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.295852 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.295940 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.296178 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.296275 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.296482 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.296575 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.296797 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.296882 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.297109 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.297202 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.297415 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.297525 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.297717 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.297811 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.298023 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.298110 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.298348 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.298432 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.298653 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.298746 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.298977 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.299063 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.299385 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.299470 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.299696 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.299838 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.300026 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.300111 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.300348 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.300433 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.300653 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.300740 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.300956 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.301042 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.301265 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.301350 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.301571 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.301680 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.301881 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.302008 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.302203 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.302318 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.302509 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.302638 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.302820 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.302950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.303634 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.303821 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.303971 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.304154 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.304275 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.304469 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.304563 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.304786 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.304874 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.305099 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.305186 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.305424 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.305518 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.305750 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.305836 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.306065 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.306151 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.306390 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.306476 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.306697 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.306811 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.307019 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.307137 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.307330 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.307452 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.307634 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.307800 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.307980 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.308131 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.308284 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.308428 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.308625 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.308713 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.308930 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.309023 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.309248 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.309362 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.309579 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.309668 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.309908 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.309995 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.310219 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.310315 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.310530 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.310624 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.310842 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.310929 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.311153 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.311240 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.311460 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.311545 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.311790 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.311880 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.312117 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.312222 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.312420 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.312505 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.312726 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.312819 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.313037 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.313123 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.313341 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.313427 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.313644 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.313730 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.313950 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.314037 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.314259 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.314352 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.314561 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.314655 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.314865 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.314950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.315168 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.315253 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.315471 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.315563 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.315816 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.315931 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.316140 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.316240 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.316448 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.316557 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.316752 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.316850 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.317056 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.317161 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.317360 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.317467 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.317701 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.317799 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.318005 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.318104 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.318332 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.318451 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.318643 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.318805 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.319022 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.319109 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.319338 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.319433 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.319645 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.319750 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.319979 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.320074 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.320294 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.320381 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.320602 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.320714 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.320912 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.321020 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.321221 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.321327 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.321527 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.321623 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.321830 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.321939 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.322138 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.322234 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.322444 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.322541 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.322774 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.322954 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.323080 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.323280 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.323404 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.323593 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.323779 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.323926 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.324044 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.324227 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.324350 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.324542 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.324656 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.324855 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.325036 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.325166 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.325311 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.325476 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.325640 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.325787 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.325954 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.326098 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.326280 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.326424 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.326597 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.326747 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.326915 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.327073 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.327233 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.327407 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.327548 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.327748 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.327890 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.328062 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.328207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.328377 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.328522 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.328689 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.328835 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.329043 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.329154 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.329359 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.329470 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.329665 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.329790 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.329978 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.330294 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.330381 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.330613 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.330733 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.330926 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.331021 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.331232 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.331319 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.331548 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.331644 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.331886 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.331979 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.332200 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.332297 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.332513 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.332601 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.332826 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.332914 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.333140 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.333245 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.333454 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.333550 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.333785 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.333886 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.334103 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.334190 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.334935 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.335042 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.335254 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.335364 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.335569 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.335657 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.335915 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.336107 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.336236 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.336425 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.336554 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.336759 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.336913 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.337087 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.337231 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.337413 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.337540 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.337729 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.337858 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.338048 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.338177 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.338375 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.338495 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.338683 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.338812 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.338986 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.339127 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.339289 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.339421 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.339601 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.339758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.339933 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.340029 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.340259 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.340347 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.340573 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.340708 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.340878 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.340967 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.341199 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.341287 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.341510 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.341596 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.341891 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.342034 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.342208 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.342383 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.342526 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.342701 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.342845 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.343029 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.343357 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.343442 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.343672 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.343788 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.344003 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.344088 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.344328 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.344415 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.344639 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.344739 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.344949 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.345047 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.345265 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.345352 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.345578 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.345666 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.345883 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.345969 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.346187 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.346272 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.346497 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.346584 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.346808 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.346893 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.347112 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.347198 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.347422 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.347517 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.347753 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.347843 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.348071 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.348162 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.348376 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.348463 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.348680 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.348767 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.348985 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.349219 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.349307 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.349568 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.349654 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.349878 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.349963 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.350238 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.350327 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.350541 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.350634 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.350852 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.350947 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.351157 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.351283 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.351466 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.351553 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.351791 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.351879 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.352105 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.352200 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.352444 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.352536 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.352757 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.352855 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.353064 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.353148 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.353373 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.353459 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.353679 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.353844 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.353985 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.354318 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.354541 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.354625 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.354852 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.354946 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.355157 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.355242 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.355475 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.355559 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.355807 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.355914 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.356116 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.356201 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.356425 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.356511 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.356740 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.356968 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.357063 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.357302 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.357390 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.357625 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.357719 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.357928 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.358013 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.358242 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.358336 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.358548 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.358642 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.358862 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.358948 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.359165 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.359258 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.359474 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.359568 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.359808 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.359895 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.360124 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.360211 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.360436 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.360531 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.360751 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.360884 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.361063 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.361162 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.361372 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.361460 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.361680 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.361764 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.361991 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.362076 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.362305 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.362391 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.362614 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.362700 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.362924 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.363016 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.363232 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.363319 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.363542 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.363628 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.363879 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.364134 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.364230 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.364478 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.364572 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.364805 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.364892 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.365133 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.365220 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.365450 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.365580 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.366301 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.366389 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.366612 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.366698 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.366920 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.367005 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.367230 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.367325 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.367540 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.367627 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.367880 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.367966 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.368198 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.368297 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.368514 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.368601 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.368818 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.368903 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.369131 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.369444 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.369532 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.369757 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.369844 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.370070 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.370165 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.370383 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.370469 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.370694 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.370782 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.371006 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.371114 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.371319 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.371406 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.371629 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.371742 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.371970 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.372072 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.372287 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.372379 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.372620 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.372707 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.372939 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.373026 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.373258 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.373344 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.373577 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.373662 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.373891 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.373978 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.374195 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.374280 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.374502 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.374589 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.374811 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.374897 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.375128 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.375214 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.375438 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.375522 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.375762 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.375854 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.376070 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.376156 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.376381 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.376686 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.376773 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.376991 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.377077 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.377295 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.377381 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.377600 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.377687 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.377909 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.378004 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.378212 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.378297 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.378516 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.378603 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.378820 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.378906 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.379124 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.379218 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.379428 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.379517 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.379747 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.379883 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.380062 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.380230 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.380366 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.380566 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.380672 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.380897 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.380986 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.381210 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.381375 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.381569 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.381667 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.381878 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.381964 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.382238 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.382332 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.382520 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.382608 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.382836 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.382931 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.383144 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.383238 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.383452 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.383541 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.383788 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.383953 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.384099 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.384193 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.384408 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.384495 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.384714 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.384810 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.385021 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.385107 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.385333 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.385419 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.385640 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.385777 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.385952 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.386038 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.386256 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.386341 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.386564 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.386652 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.386870 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.386956 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.387175 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.387268 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.387486 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.387574 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.387816 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.387905 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.388126 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.388211 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.388433 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.388534 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.388740 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.388827 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.389046 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.389140 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.389363 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.389448 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.389677 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.389763 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.390008 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.390104 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.390323 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.390410 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.390634 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.390725 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.390943 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.391037 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.391256 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.391352 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.391569 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.391756 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.391910 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.391998 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.392224 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.392310 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.392537 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.392622 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.392857 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.392943 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.393171 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.393257 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.393486 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.393573 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.393801 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.393889 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.394112 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.394198 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.394422 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.394507 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.394737 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.394833 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.395067 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.395153 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.395389 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.395481 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.395698 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.395953 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.396055 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.396141 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.396375 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.396471 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.396698 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.396783 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.397528 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.397629 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.397770 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 17:21:51.397864 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.398168 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.398484 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.398799 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.399113 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.399427 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.399763 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.400086 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.400400 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.400714 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.401034 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.401350 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.401680 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.402010 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.402324 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.402653 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.402983 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.403330 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.403646 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.404016 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.404352 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.404671 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.404986 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.405293 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:21:51.405540 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103798) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 17:21:51.551608 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO dbcounter [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] Registered counter for database nova_api Oct 27 17:21:51.558616 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO dbcounter [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] Registered counter for database nova_api Oct 27 17:21:51.572021 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_db.sqlalchemy.engines [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 17:21:51.578877 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_db.sqlalchemy.engines [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 17:21:51.580089 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writer thread running {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 17:21:51.585457 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writer thread running {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 17:21:51.638332 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.context [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9e2082a-7e53-41e4-a8a5-142e829788d7(cell1) {{(pid=103797) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 17:21:51.642165 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:21:51.642474 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.context [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9e2082a-7e53-41e4-a8a5-142e829788d7(cell1) {{(pid=103798) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 17:21:51.642637 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:21:51.644276 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:21:51.645041 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:21:51.645480 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:21:51.646340 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:21:51.646818 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:21:51.647520 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_concurrency.lockutils [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:21:51.648520 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:21:51.649238 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:21:51.649532 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO dbcounter [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] Registered counter for database nova_cell0 Oct 27 17:21:51.649677 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:21:51.651673 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:21:51.653610 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO dbcounter [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] Registered counter for database nova_cell1 Oct 27 17:21:51.653737 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO dbcounter [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] Registered counter for database nova_cell0 Oct 27 17:21:51.657944 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO dbcounter [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] Registered counter for database nova_cell1 Oct 27 17:21:51.661448 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_db.sqlalchemy.engines [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 17:21:51.663753 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_db.sqlalchemy.engines [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 17:21:51.665607 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_db.sqlalchemy.engines [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 17:21:51.668383 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_db.sqlalchemy.engines [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 17:21:51.670306 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writer thread running {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 17:21:51.671800 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writer thread running {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 17:21:51.673019 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writer thread running {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 17:21:51.676394 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writer thread running {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 17:21:51.815825 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO dbcounter [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] Registered counter for database nova_cell0 Oct 27 17:21:51.820652 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO dbcounter [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] Registered counter for database nova_cell0 Oct 27 17:21:51.824999 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG oslo_db.sqlalchemy.engines [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 17:21:51.827555 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_db.sqlalchemy.engines [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103798) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 17:21:51.829331 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writer thread running {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 17:21:51.832280 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writer thread running {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 17:21:52.169978 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: WARNING keystonemiddleware.auth_token [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 17:21:52.170818 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: WARNING keystonemiddleware.auth_token [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 17:21:52.177286 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: WARNING keystonemiddleware.auth_token [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 17:21:52.178048 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: WARNING keystonemiddleware.auth_token [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 17:21:52.526163 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: WARNING keystonemiddleware.auth_token [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 17:21:52.528939 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: WARNING keystonemiddleware.auth_token [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 17:21:52.532278 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: WARNING keystonemiddleware.auth_token [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 17:21:52.534904 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: WARNING keystonemiddleware.auth_token [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 17:21:52.537640 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580705b49c0 pid: 103797 (default app) Oct 27 17:21:52.540132 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:21:52.541755 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580705b49c0 pid: 103798 (default app) Oct 27 17:21:52.541962 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-34102b80-ac6e-4061-b86d-5e07db774625 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002333 Oct 27 17:21:52.542481 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Thu Oct 27 17:21:52 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:23:13.704231 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:23:13.705468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002037 Oct 27 17:23:13.705865 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 931 bytes} [Thu Oct 27 17:23:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:23:13.722151 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_api:SELECT=3 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:23:13.723318 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_cell0:SELECT=3 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:23:13.724427 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_cell1:SELECT=3 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:23:13.725309 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:23:14.575315 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-057c10a6-1821-4534-94ad-60315921d04b admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:23:14.607793 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-057c10a6-1821-4534-94ad-60315921d04b admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.895927 Oct 27 17:23:14.609139 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1292 bytes} [Thu Oct 27 17:23:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:23:17.230214 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:23:17.231227 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-d91c66d1-9572-4003-bbb9-fb9e9a75f8fc None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Oct 27 17:23:17.231850 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 2/4] 10.222.0.36 () {54 vars in 931 bytes} [Thu Oct 27 17:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:23:17.680955 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-61f33402-e686-4a22-828e-fd4042f14227 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:17.728798 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-61f33402-e686-4a22-828e-fd4042f14227 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.490527 Oct 27 17:23:17.729359 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 3/5] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Oct 27 17:23:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:23:17.744229 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writing DB stats nova_api:SELECT=3 {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:23:17.745082 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writing DB stats nova_cell0:SELECT=3 {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:23:17.747025 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writing DB stats nova_cell1:SELECT=3 {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:23:17.747807 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:23:17.956198 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-b5dcd2d5-342a-47c5-bbe4-2b4794453fcb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:18.025400 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-b5dcd2d5-342a-47c5-bbe4-2b4794453fcb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286931 Oct 27 17:23:18.025917 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 3/6] 10.222.0.36 () {64 vars in 1336 bytes} [Thu Oct 27 17:23:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:23:20.640694 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-61f33402-e686-4a22-828e-fd4042f14227 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:23:20.641752 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-61f33402-e686-4a22-828e-fd4042f14227 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 27 17:23:20.642148 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 4/7] 10.222.0.36 () {54 vars in 931 bytes} [Thu Oct 27 17:23:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:23:21.282507 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-b01b4226-0554-454c-8a7e-a64cadbf6859 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:21.324679 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-b01b4226-0554-454c-8a7e-a64cadbf6859 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.676315 Oct 27 17:23:21.331846 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 4/8] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Oct 27 17:23:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:23:21.338004 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-7d5bacb9-8c19-4a97-92a7-2142bab626b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:21.375959 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-7d5bacb9-8c19-4a97-92a7-2142bab626b7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041512 Oct 27 17:23:21.376539 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 5/9] 10.222.0.36 () {64 vars in 1336 bytes} [Thu Oct 27 17:23:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:23:23.978079 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-b01b4226-0554-454c-8a7e-a64cadbf6859 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:23:23.979098 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-b01b4226-0554-454c-8a7e-a64cadbf6859 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 27 17:23:23.979728 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 931 bytes} [Thu Oct 27 17:23:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:23:24.390517 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-8b4603f2-f554-464d-bc01-6b0882cf0531 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:24.411317 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-8b4603f2-f554-464d-bc01-6b0882cf0531 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.424579 Oct 27 17:23:24.411795 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 6/11] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Oct 27 17:23:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 17:23:24.424707 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-2687662b-ef1b-4162-b38b-3d41d9926bec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:24.452223 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-2687662b-ef1b-4162-b38b-3d41d9926bec admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031821 Oct 27 17:23:24.452823 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 6/12] 10.222.0.36 () {64 vars in 1336 bytes} [Thu Oct 27 17:23:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:23:27.077301 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-8b4603f2-f554-464d-bc01-6b0882cf0531 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:23:27.079054 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-8b4603f2-f554-464d-bc01-6b0882cf0531 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 Oct 27 17:23:27.079562 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 7/13] 10.222.0.36 () {54 vars in 931 bytes} [Thu Oct 27 17:23:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:23:27.512114 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-1f842f6b-c849-4c70-b756-719e2739fd9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 2, "id": "d3", "swap": 0, "name": "ds2G", "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:27.532649 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-1f842f6b-c849-4c70-b756-719e2739fd9d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446914 Oct 27 17:23:27.533359 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 7/14] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Oct 27 17:23:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:23:27.545516 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-936c8e62-53c5-4ca9-8d94-218a684bccb7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:27.579416 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-936c8e62-53c5-4ca9-8d94-218a684bccb7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037491 Oct 27 17:23:27.580224 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 8/15] 10.222.0.36 () {64 vars in 1336 bytes} [Thu Oct 27 17:23:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:23:30.222083 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-1f842f6b-c849-4c70-b756-719e2739fd9d admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:23:30.223032 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-1f842f6b-c849-4c70-b756-719e2739fd9d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 27 17:23:30.223430 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 8/16] 10.222.0.36 () {54 vars in 931 bytes} [Thu Oct 27 17:23:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:23:30.662324 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-3ec23c51-e368-4d06-88af-34579775a79d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096, "disk": 20, "name": "ds4G"}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:30.683776 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-3ec23c51-e368-4d06-88af-34579775a79d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.453137 Oct 27 17:23:30.684381 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 9/17] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Oct 27 17:23:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:23:30.697519 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-0276f5fb-6705-41be-b2ce-db6755074fcc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:30.724906 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-0276f5fb-6705-41be-b2ce-db6755074fcc admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031860 Oct 27 17:23:30.725487 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 9/18] 10.222.0.36 () {64 vars in 1336 bytes} [Thu Oct 27 17:23:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:23:33.328760 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-3ec23c51-e368-4d06-88af-34579775a79d admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:23:33.329878 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-3ec23c51-e368-4d06-88af-34579775a79d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002156 Oct 27 17:23:33.330371 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 10/19] 10.222.0.36 () {54 vars in 931 bytes} [Thu Oct 27 17:23:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:23:33.756910 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-cf3dbf1b-090f-4261-a78b-0428baf72be4 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:23:33.786751 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-cf3dbf1b-090f-4261-a78b-0428baf72be4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.449918 Oct 27 17:23:33.788253 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 10/20] 10.222.0.36 () {60 vars in 1292 bytes} [Thu Oct 27 17:23:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:23:36.380852 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-3ec23c51-e368-4d06-88af-34579775a79d admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:23:36.381874 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-3ec23c51-e368-4d06-88af-34579775a79d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 27 17:23:36.382303 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 11/21] 10.222.0.36 () {54 vars in 931 bytes} [Thu Oct 27 17:23:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:23:36.780479 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-053a8476-5589-4c20-b7a1-d4a0053b5dc7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:36.802357 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-053a8476-5589-4c20-b7a1-d4a0053b5dc7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.413747 Oct 27 17:23:36.802901 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 11/22] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Oct 27 17:23:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 17:23:36.815062 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-e32e46bc-8972-4e21-b72e-f49350ef1270 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:36.842168 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-e32e46bc-8972-4e21-b72e-f49350ef1270 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030946 Oct 27 17:23:36.842734 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 12/23] 10.222.0.36 () {64 vars in 1333 bytes} [Thu Oct 27 17:23:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:23:39.776499 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-053a8476-5589-4c20-b7a1-d4a0053b5dc7 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:23:39.777457 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-053a8476-5589-4c20-b7a1-d4a0053b5dc7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 27 17:23:39.777891 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 931 bytes} [Thu Oct 27 17:23:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:23:40.168340 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-53dae65b-55d2-4ab9-8718-344639c0ef84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "vcpus": 1, "ram": 2048, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:40.190476 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-53dae65b-55d2-4ab9-8718-344639c0ef84 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.405817 Oct 27 17:23:40.191033 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 13/25] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Oct 27 17:23:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:23:40.206222 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-7dfdc1d5-633d-4b2c-80ff-e2e35e872695 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:40.236769 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-7dfdc1d5-633d-4b2c-80ff-e2e35e872695 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035877 Oct 27 17:23:40.237566 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 13/26] 10.222.0.36 () {64 vars in 1333 bytes} [Thu Oct 27 17:23:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:23:42.856297 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-53dae65b-55d2-4ab9-8718-344639c0ef84 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:23:42.857941 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-53dae65b-55d2-4ab9-8718-344639c0ef84 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002128 Oct 27 17:23:42.867792 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 14/27] 10.222.0.36 () {54 vars in 931 bytes} [Thu Oct 27 17:23:42 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:23:43.364975 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-67d89df3-afd5-4aed-8797-ed1f9be717a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:43.387903 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-67d89df3-afd5-4aed-8797-ed1f9be717a0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.522502 Oct 27 17:23:43.392087 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 14/28] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Oct 27 17:23:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 17:23:43.400706 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-c0f49819-989b-4f0f-ac9a-f7e69390cc27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:43.428834 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-c0f49819-989b-4f0f-ac9a-f7e69390cc27 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031752 Oct 27 17:23:43.429599 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 15/29] 10.222.0.36 () {64 vars in 1333 bytes} [Thu Oct 27 17:23:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:23:46.059245 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-67d89df3-afd5-4aed-8797-ed1f9be717a0 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:23:46.060389 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-67d89df3-afd5-4aed-8797-ed1f9be717a0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Oct 27 17:23:46.062439 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 15/30] 10.222.0.36 () {54 vars in 931 bytes} [Thu Oct 27 17:23:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:23:46.505641 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-aa3f3532-6f90-47f5-8d9c-116848d15f7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "disk": 80, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:46.512458 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:23:46.527519 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-aa3f3532-6f90-47f5-8d9c-116848d15f7a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460258 Oct 27 17:23:46.528095 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 16/31] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Oct 27 17:23:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 17:23:46.540878 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-6c3518f7-d28a-4b75-815f-3a512d85249c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:46.566712 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-6c3518f7-d28a-4b75-815f-3a512d85249c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029446 Oct 27 17:23:46.567642 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 16/32] 10.222.0.36 () {64 vars in 1333 bytes} [Thu Oct 27 17:23:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:23:49.235506 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-aa3f3532-6f90-47f5-8d9c-116848d15f7a admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:23:49.236479 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-aa3f3532-6f90-47f5-8d9c-116848d15f7a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Oct 27 17:23:49.237151 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 17/33] 10.222.0.36 () {54 vars in 931 bytes} [Thu Oct 27 17:23:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:23:49.693459 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-e8dcd1d5-ce20-41b8-b3ee-7c97528546c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "5", "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160, "vcpus": 8}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:49.701166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:23:49.716601 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-e8dcd1d5-ce20-41b8-b3ee-7c97528546c9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.473474 Oct 27 17:23:49.717227 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 17/34] 10.222.0.36 () {64 vars in 1283 bytes} [Thu Oct 27 17:23:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:23:49.737890 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-95a239f3-0857-4473-aa78-8adc4f385af6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:23:49.763475 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-95a239f3-0857-4473-aa78-8adc4f385af6 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030857 Oct 27 17:23:49.764090 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 18/35] 10.222.0.36 () {64 vars in 1333 bytes} [Thu Oct 27 17:23:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:24:07.164561 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-e8dcd1d5-ce20-41b8-b3ee-7c97528546c9 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:07.165625 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-e8dcd1d5-ce20-41b8-b3ee-7c97528546c9 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Oct 27 17:24:07.166049 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 18/36] 10.222.0.36 () {54 vars in 931 bytes} [Thu Oct 27 17:24:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:24:07.177222 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:24:07.549486 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-61c0a728-5798-4d81-8859-0ec41f1703ad admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:07.567424 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-61c0a728-5798-4d81-8859-0ec41f1703ad admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.394647 Oct 27 17:24:07.567982 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 19/37] 10.222.0.36 () {60 vars in 1292 bytes} [Thu Oct 27 17:24:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:24:08.857759 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-e8dcd1d5-ce20-41b8-b3ee-7c97528546c9 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:08.859387 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-e8dcd1d5-ce20-41b8-b3ee-7c97528546c9 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002056 Oct 27 17:24:08.859803 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 19/38] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Oct 27 17:24:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:24:09.390086 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-7d7264bc-82e0-4555-90fc-7100cc270652 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:09.395438 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.wsgi [None req-7d7264bc-82e0-4555-90fc-7100cc270652 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-7d7264bc-82e0-4555-90fc-7100cc270652 admin admin] Request method failure captured: Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Accept: application/json Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Accept-Encoding: gzip, deflate Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Connection: keep-alive Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Content-Length: 0 Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Host: 10.222.0.36 Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Openstack-Api-Version: compute 2.92 Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Openstack-System-Scope: None Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: User-Agent: python-novaclient Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Auth-Token: gAAAAABjWr64XrX_w2k-8BcQHwdeY8sv1fwuGXvQ4-Qlo3crwVBqUhYp4iOg8s_fnJZyZZGVY4FYwHeCRd7wTZGAF_uc7c_N8eAuH6BwCPOPpTdgpjt_Bni75tmXoymxTkYP5uOUE_KwPC2FeYX5rmZ77wkJHZsWlI2gNpQiaKkHbEbUP3AFeZY Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Domain-Id: None Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Domain-Name: None Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Identity-Status: Confirmed Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Is-Admin-Project: True Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Project-Domain-Id: default Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Project-Domain-Name: Default Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Project-Id: 5e5c1599f7244339bead4f7fd0c1db3a Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Project-Name: admin Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Role: reader,member,admin Oct 27 17:24:09.398717 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Roles: reader,member,admin Oct 27 17:24:09.400373 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e5c1599f7244339bead4f7fd0c1db3a"}]}] Oct 27 17:24:09.400373 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Tenant: admin Oct 27 17:24:09.400373 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Tenant-Id: 5e5c1599f7244339bead4f7fd0c1db3a Oct 27 17:24:09.400373 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Tenant-Name: admin Oct 27 17:24:09.400373 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-User: admin Oct 27 17:24:09.400373 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-User-Domain-Id: default Oct 27 17:24:09.400373 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-User-Domain-Name: Default Oct 27 17:24:09.400373 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-User-Id: 95a834a1fe8b40e0a8492b345e9685c8 Oct 27 17:24:09.400373 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-User-Name: admin Oct 27 17:24:09.400373 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: method: > Oct 27 17:24:09.400373 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: exception: Flavor 42 could not be found. Oct 27 17:24:09.400373 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: action_args: {'id': '42'} Oct 27 17:24:09.400373 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:24:09.400373 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:24:09.401392 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Oct 27 17:24:09.402564 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-7d7264bc-82e0-4555-90fc-7100cc270652 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:24:09.403700 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-7d7264bc-82e0-4555-90fc-7100cc270652 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389889 Oct 27 17:24:09.403700 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 20/39] 10.222.0.36 () {60 vars in 1190 bytes} [Thu Oct 27 17:24:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 17:24:09.410624 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-9380b56d-ec9b-4d1c-984a-67cba85e9b8a admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:09.433093 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-9380b56d-ec9b-4d1c-984a-67cba85e9b8a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026360 Oct 27 17:24:09.433619 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Oct 27 17:24:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:24:09.444535 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-f239a869-15b2-469d-9591-f18844d88f75 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:09.466377 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-f239a869-15b2-469d-9591-f18844d88f75 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026312 Oct 27 17:24:09.466907 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 21/41] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Oct 27 17:24:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:24:09.476439 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-1c486432-5a16-449c-8e32-b3a3a99ad1c3 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:09.481504 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.wsgi [None req-1c486432-5a16-449c-8e32-b3a3a99ad1c3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-1c486432-5a16-449c-8e32-b3a3a99ad1c3 admin admin] Request method failure captured: Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Accept: application/json Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Accept-Encoding: gzip, deflate Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Connection: keep-alive Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Content-Length: 0 Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Host: 10.222.0.36 Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Openstack-Api-Version: compute 2.92 Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Openstack-System-Scope: None Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: User-Agent: python-novaclient Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Auth-Token: gAAAAABjWr64XrX_w2k-8BcQHwdeY8sv1fwuGXvQ4-Qlo3crwVBqUhYp4iOg8s_fnJZyZZGVY4FYwHeCRd7wTZGAF_uc7c_N8eAuH6BwCPOPpTdgpjt_Bni75tmXoymxTkYP5uOUE_KwPC2FeYX5rmZ77wkJHZsWlI2gNpQiaKkHbEbUP3AFeZY Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Domain-Id: None Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Domain-Name: None Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Identity-Status: Confirmed Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Is-Admin-Project: True Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Project-Domain-Id: default Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Project-Domain-Name: Default Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Project-Id: 5e5c1599f7244339bead4f7fd0c1db3a Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Project-Name: admin Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Role: reader,member,admin Oct 27 17:24:09.485207 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Roles: reader,member,admin Oct 27 17:24:09.486750 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e5c1599f7244339bead4f7fd0c1db3a"}]}] Oct 27 17:24:09.486750 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Tenant: admin Oct 27 17:24:09.486750 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Tenant-Id: 5e5c1599f7244339bead4f7fd0c1db3a Oct 27 17:24:09.486750 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Tenant-Name: admin Oct 27 17:24:09.486750 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-User: admin Oct 27 17:24:09.486750 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-User-Domain-Id: default Oct 27 17:24:09.486750 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-User-Domain-Name: Default Oct 27 17:24:09.486750 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-User-Id: 95a834a1fe8b40e0a8492b345e9685c8 Oct 27 17:24:09.486750 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-User-Name: admin Oct 27 17:24:09.486750 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: method: > Oct 27 17:24:09.486750 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: exception: Flavor 42 could not be found. Oct 27 17:24:09.486750 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: action_args: {'id': '42'} Oct 27 17:24:09.486750 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:24:09.486750 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:24:09.487758 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Oct 27 17:24:09.489166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-1c486432-5a16-449c-8e32-b3a3a99ad1c3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:24:09.490427 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-1c486432-5a16-449c-8e32-b3a3a99ad1c3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014102 Oct 27 17:24:09.490427 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1190 bytes} [Thu Oct 27 17:24:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 17:24:10.682987 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-f239a869-15b2-469d-9591-f18844d88f75 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:10.684018 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-f239a869-15b2-469d-9591-f18844d88f75 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 27 17:24:10.684410 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 22/43] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Oct 27 17:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:24:11.201609 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-e720682c-a49e-445f-9345-f52609b71787 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:11.206530 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.wsgi [None req-e720682c-a49e-445f-9345-f52609b71787 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-e720682c-a49e-445f-9345-f52609b71787 admin admin] Request method failure captured: Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Accept: application/json Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Accept-Encoding: gzip, deflate Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Connection: keep-alive Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Content-Length: 0 Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Host: 10.222.0.36 Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Openstack-Api-Version: compute 2.92 Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Openstack-System-Scope: None Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: User-Agent: python-novaclient Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Auth-Token: gAAAAABjWr669r1g3x8F5cjt3r7ybZ0xDWrr0PQXElsjKx9lxGJHBhmcghh-7p0AQFDffAMVcJ14qQ30SvZGdCFFL2YEvAAH0zO3YKxJy7bl4A63_Odw4SFJ3XCRsFxlVG6E7doKD0x6yEI1ZqqWUkHZpcx561shWQ2QSKkYvyjtpWzOqsUVteM Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Domain-Id: None Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Domain-Name: None Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Identity-Status: Confirmed Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Is-Admin-Project: True Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Project-Domain-Id: default Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Project-Domain-Name: Default Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Project-Id: 5e5c1599f7244339bead4f7fd0c1db3a Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Project-Name: admin Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Role: reader,member,admin Oct 27 17:24:11.208062 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Roles: reader,member,admin Oct 27 17:24:11.209428 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e5c1599f7244339bead4f7fd0c1db3a"}]}] Oct 27 17:24:11.209428 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Tenant: admin Oct 27 17:24:11.209428 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Tenant-Id: 5e5c1599f7244339bead4f7fd0c1db3a Oct 27 17:24:11.209428 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Tenant-Name: admin Oct 27 17:24:11.209428 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-User: admin Oct 27 17:24:11.209428 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-User-Domain-Id: default Oct 27 17:24:11.209428 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-User-Domain-Name: Default Oct 27 17:24:11.209428 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-User-Id: 95a834a1fe8b40e0a8492b345e9685c8 Oct 27 17:24:11.209428 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-User-Name: admin Oct 27 17:24:11.209428 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: method: > Oct 27 17:24:11.209428 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: exception: Flavor 84 could not be found. Oct 27 17:24:11.209428 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: action_args: {'id': '84'} Oct 27 17:24:11.209428 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:24:11.209428 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:24:11.210468 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Oct 27 17:24:11.211885 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-e720682c-a49e-445f-9345-f52609b71787 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:24:11.213299 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-e720682c-a49e-445f-9345-f52609b71787 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388178 Oct 27 17:24:11.213299 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 22/44] 10.222.0.36 () {60 vars in 1190 bytes} [Thu Oct 27 17:24:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 17:24:11.219660 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-e5adbd73-cd24-4376-85eb-407cec20bc46 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:11.234821 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-e5adbd73-cd24-4376-85eb-407cec20bc46 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019418 Oct 27 17:24:11.235337 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Oct 27 17:24:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:24:11.244639 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-8cc578fd-925e-467f-8963-519fd9e14317 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:11.260151 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-8cc578fd-925e-467f-8963-519fd9e14317 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019016 Oct 27 17:24:11.260769 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 23/46] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Oct 27 17:24:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:24:11.270643 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-ee62eaa8-fdeb-4d3c-bbe4-25b6c1e301ff admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:11.275517 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.wsgi [None req-ee62eaa8-fdeb-4d3c-bbe4-25b6c1e301ff admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-ee62eaa8-fdeb-4d3c-bbe4-25b6c1e301ff admin admin] Request method failure captured: Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Accept: application/json Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Accept-Encoding: gzip, deflate Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Connection: keep-alive Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Content-Length: 0 Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Host: 10.222.0.36 Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Openstack-Api-Version: compute 2.92 Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Openstack-System-Scope: None Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: User-Agent: python-novaclient Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Auth-Token: gAAAAABjWr669r1g3x8F5cjt3r7ybZ0xDWrr0PQXElsjKx9lxGJHBhmcghh-7p0AQFDffAMVcJ14qQ30SvZGdCFFL2YEvAAH0zO3YKxJy7bl4A63_Odw4SFJ3XCRsFxlVG6E7doKD0x6yEI1ZqqWUkHZpcx561shWQ2QSKkYvyjtpWzOqsUVteM Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Domain-Id: None Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Domain-Name: None Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Identity-Status: Confirmed Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Is-Admin-Project: True Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Project-Domain-Id: default Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Project-Domain-Name: Default Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Project-Id: 5e5c1599f7244339bead4f7fd0c1db3a Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Project-Name: admin Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Role: reader,member,admin Oct 27 17:24:11.277036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Roles: reader,member,admin Oct 27 17:24:11.278615 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e5c1599f7244339bead4f7fd0c1db3a"}]}] Oct 27 17:24:11.278615 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Tenant: admin Oct 27 17:24:11.278615 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Tenant-Id: 5e5c1599f7244339bead4f7fd0c1db3a Oct 27 17:24:11.278615 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Tenant-Name: admin Oct 27 17:24:11.278615 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-User: admin Oct 27 17:24:11.278615 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-User-Domain-Id: default Oct 27 17:24:11.278615 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-User-Domain-Name: Default Oct 27 17:24:11.278615 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-User-Id: 95a834a1fe8b40e0a8492b345e9685c8 Oct 27 17:24:11.278615 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-User-Name: admin Oct 27 17:24:11.278615 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: method: > Oct 27 17:24:11.278615 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: exception: Flavor 84 could not be found. Oct 27 17:24:11.278615 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: action_args: {'id': '84'} Oct 27 17:24:11.278615 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:24:11.278615 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:24:11.279595 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Oct 27 17:24:11.281017 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-ee62eaa8-fdeb-4d3c-bbe4-25b6c1e301ff admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:24:11.282255 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-ee62eaa8-fdeb-4d3c-bbe4-25b6c1e301ff admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011304 Oct 27 17:24:11.282255 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 24/47] 10.222.0.36 () {60 vars in 1190 bytes} [Thu Oct 27 17:24:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 17:24:12.465257 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-8cc578fd-925e-467f-8963-519fd9e14317 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:12.466295 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-8cc578fd-925e-467f-8963-519fd9e14317 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 27 17:24:12.466689 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 24/48] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Oct 27 17:24:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:24:12.980252 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-844a8e58-710f-4cf6-bedf-563a59796935 admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:12.986138 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.wsgi [None req-844a8e58-710f-4cf6-bedf-563a59796935 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-844a8e58-710f-4cf6-bedf-563a59796935 admin admin] Request method failure captured: Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Accept: application/json Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Accept-Encoding: gzip, deflate Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Connection: keep-alive Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Content-Length: 0 Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Host: 10.222.0.36 Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Openstack-Api-Version: compute 2.92 Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Openstack-System-Scope: None Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: User-Agent: python-novaclient Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Auth-Token: gAAAAABjWr684tPY6AqtQ-iRs3GFI7FHsQg7lFNCRIwA2SkRg_obzF0bcqBgSR6As3qNosY72S5rcj07o1vr-9X2Looq8zN3E4VFwniW2lJhoBGLMRHl8fIbMyDr5A7UanTdjeIdKVaWfohnxcCVqoL1fl94R-oL2ZYmgoHWfS-2hJr7DM2hasg Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Domain-Id: None Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Domain-Name: None Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Identity-Status: Confirmed Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Is-Admin-Project: True Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Project-Domain-Id: default Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Project-Domain-Name: Default Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Project-Id: 5e5c1599f7244339bead4f7fd0c1db3a Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Project-Name: admin Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Role: reader,member,admin Oct 27 17:24:12.987623 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Roles: reader,member,admin Oct 27 17:24:12.989172 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e5c1599f7244339bead4f7fd0c1db3a"}]}] Oct 27 17:24:12.989172 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Tenant: admin Oct 27 17:24:12.989172 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Tenant-Id: 5e5c1599f7244339bead4f7fd0c1db3a Oct 27 17:24:12.989172 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-Tenant-Name: admin Oct 27 17:24:12.989172 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-User: admin Oct 27 17:24:12.989172 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-User-Domain-Id: default Oct 27 17:24:12.989172 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-User-Domain-Name: Default Oct 27 17:24:12.989172 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-User-Id: 95a834a1fe8b40e0a8492b345e9685c8 Oct 27 17:24:12.989172 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: X-User-Name: admin Oct 27 17:24:12.989172 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: method: > Oct 27 17:24:12.989172 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: exception: Flavor 451 could not be found. Oct 27 17:24:12.989172 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: action_args: {'id': '451'} Oct 27 17:24:12.989172 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:24:12.989172 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:24:12.990209 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: ERROR nova.api.openstack.wsgi Oct 27 17:24:12.991823 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-844a8e58-710f-4cf6-bedf-563a59796935 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:24:12.993069 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-844a8e58-710f-4cf6-bedf-563a59796935 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.385944 Oct 27 17:24:12.993069 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 25/49] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Oct 27 17:24:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 17:24:12.998478 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-b76f48c5-5309-4046-bc41-8af3737f51dc admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:13.013031 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-b76f48c5-5309-4046-bc41-8af3737f51dc admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018091 Oct 27 17:24:13.013553 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 25/50] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Oct 27 17:24:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:24:13.023085 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-e4a490b0-d0a8-4040-8c3c-a202b0cf1e4f admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:13.038262 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-e4a490b0-d0a8-4040-8c3c-a202b0cf1e4f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018712 Oct 27 17:24:13.038784 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 26/51] 10.222.0.36 () {60 vars in 1210 bytes} [Thu Oct 27 17:24:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:24:13.047658 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-ae6ee05b-8611-4824-be33-4487b06e594b admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:13.052550 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.wsgi [None req-ae6ee05b-8611-4824-be33-4487b06e594b admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-ae6ee05b-8611-4824-be33-4487b06e594b admin admin] Request method failure captured: Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Accept: application/json Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Accept-Encoding: gzip, deflate Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Connection: keep-alive Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Content-Length: 0 Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Host: 10.222.0.36 Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Openstack-Api-Version: compute 2.92 Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Openstack-System-Scope: None Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: User-Agent: python-novaclient Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Auth-Token: gAAAAABjWr684tPY6AqtQ-iRs3GFI7FHsQg7lFNCRIwA2SkRg_obzF0bcqBgSR6As3qNosY72S5rcj07o1vr-9X2Looq8zN3E4VFwniW2lJhoBGLMRHl8fIbMyDr5A7UanTdjeIdKVaWfohnxcCVqoL1fl94R-oL2ZYmgoHWfS-2hJr7DM2hasg Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Domain-Id: None Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Domain-Name: None Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Identity-Status: Confirmed Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Is-Admin-Project: True Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Project-Domain-Id: default Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Project-Domain-Name: Default Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Project-Id: 5e5c1599f7244339bead4f7fd0c1db3a Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Project-Name: admin Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Role: reader,member,admin Oct 27 17:24:13.054035 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Roles: reader,member,admin Oct 27 17:24:13.055545 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5e5c1599f7244339bead4f7fd0c1db3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5e5c1599f7244339bead4f7fd0c1db3a"}]}] Oct 27 17:24:13.055545 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Tenant: admin Oct 27 17:24:13.055545 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Tenant-Id: 5e5c1599f7244339bead4f7fd0c1db3a Oct 27 17:24:13.055545 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-Tenant-Name: admin Oct 27 17:24:13.055545 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-User: admin Oct 27 17:24:13.055545 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-User-Domain-Id: default Oct 27 17:24:13.055545 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-User-Domain-Name: Default Oct 27 17:24:13.055545 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-User-Id: 95a834a1fe8b40e0a8492b345e9685c8 Oct 27 17:24:13.055545 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: X-User-Name: admin Oct 27 17:24:13.055545 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: method: > Oct 27 17:24:13.055545 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: exception: Flavor 451 could not be found. Oct 27 17:24:13.055545 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: action_args: {'id': '451'} Oct 27 17:24:13.055545 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:24:13.055545 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:24:13.056661 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: ERROR nova.api.openstack.wsgi Oct 27 17:24:13.057950 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-ae6ee05b-8611-4824-be33-4487b06e594b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103798) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:24:13.059191 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-ae6ee05b-8611-4824-be33-4487b06e594b admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011189 Oct 27 17:24:13.059191 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 26/52] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Oct 27 17:24:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 17:24:14.246716 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-e4a490b0-d0a8-4040-8c3c-a202b0cf1e4f admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:14.247734 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-e4a490b0-d0a8-4040-8c3c-a202b0cf1e4f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 27 17:24:14.248151 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 27/53] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Oct 27 17:24:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:24:14.764870 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-eb0f80bc-f40b-4627-a351-0b14e266dc1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:24:14.785177 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-eb0f80bc-f40b-4627-a351-0b14e266dc1f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.398797 Oct 27 17:24:14.785730 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 27/54] 10.222.0.36 () {64 vars in 1235 bytes} [Thu Oct 27 17:24:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:24:15.987284 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-e4a490b0-d0a8-4040-8c3c-a202b0cf1e4f admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:15.988335 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-e4a490b0-d0a8-4040-8c3c-a202b0cf1e4f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 27 17:24:15.988728 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Oct 27 17:24:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:24:16.505922 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-0f61c7b3-4d25-4c76-b406-593c9a383da8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:24:16.523834 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-0f61c7b3-4d25-4c76-b406-593c9a383da8 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.397256 Oct 27 17:24:16.524366 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 28/56] 10.222.0.36 () {64 vars in 1235 bytes} [Thu Oct 27 17:24:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:24:17.722001 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-e4a490b0-d0a8-4040-8c3c-a202b0cf1e4f admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:17.722998 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-e4a490b0-d0a8-4040-8c3c-a202b0cf1e4f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 27 17:24:17.723388 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 29/57] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Oct 27 17:24:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:24:18.238025 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-638fa777-a299-4f03-b796-c17d672c9a70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:24:18.256572 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-638fa777-a299-4f03-b796-c17d672c9a70 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.395726 Oct 27 17:24:18.257106 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 29/58] 10.222.0.36 () {64 vars in 1235 bytes} [Thu Oct 27 17:24:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 17:24:19.447326 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-e4a490b0-d0a8-4040-8c3c-a202b0cf1e4f admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:19.448360 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-e4a490b0-d0a8-4040-8c3c-a202b0cf1e4f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 27 17:24:19.448752 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 30/59] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Oct 27 17:24:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:24:19.962941 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-4a3cf8af-ae7b-4629-8b47-20403418566c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:24:19.981478 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-4a3cf8af-ae7b-4629-8b47-20403418566c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.395186 Oct 27 17:24:19.982021 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 30/60] 10.222.0.36 () {64 vars in 1235 bytes} [Thu Oct 27 17:24:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:24:21.169582 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-e4a490b0-d0a8-4040-8c3c-a202b0cf1e4f admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:21.171124 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-e4a490b0-d0a8-4040-8c3c-a202b0cf1e4f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001956 Oct 27 17:24:21.171513 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 31/61] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Oct 27 17:24:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:24:21.688591 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-980053b5-31c1-43e1-b5a3-4242e118e696 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:24:21.708501 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-980053b5-31c1-43e1-b5a3-4242e118e696 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401707 Oct 27 17:24:21.709048 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 31/62] 10.222.0.36 () {60 vars in 1202 bytes} [Thu Oct 27 17:24:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:25:17.839728 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-e4a490b0-d0a8-4040-8c3c-a202b0cf1e4f admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:25:17.840798 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-e4a490b0-d0a8-4040-8c3c-a202b0cf1e4f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Oct 27 17:25:17.841214 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 32/63] 10.222.0.36 () {54 vars in 931 bytes} [Thu Oct 27 17:25:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:25:17.852154 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:25:18.237810 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-452853cb-249c-49c7-8ff1-c7f41c6c941d admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:25:18.258336 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-452853cb-249c-49c7-8ff1-c7f41c6c941d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410887 Oct 27 17:25:18.258878 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 32/64] 10.222.0.36 () {60 vars in 1292 bytes} [Thu Oct 27 17:25:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:25:18.280806 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_api:SELECT=14 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:25:18.284704 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-6ce227c4-4167-4c72-bbec-ecd373c9fa5a admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:25:18.292096 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-6ce227c4-4167-4c72-bbec-ecd373c9fa5a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012853 Oct 27 17:25:18.292616 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 33/65] 10.222.0.36 () {60 vars in 1283 bytes} [Thu Oct 27 17:25:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:25:18.304633 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-a8193c82-be45-40a6-8c95-1012de99c7d4 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:25:18.312311 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-a8193c82-be45-40a6-8c95-1012de99c7d4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010601 Oct 27 17:25:18.312826 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 33/66] 10.222.0.36 () {60 vars in 1286 bytes} [Thu Oct 27 17:25:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:25:18.324036 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-7ac9cb57-393c-4261-8148-1940a07205be admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:25:18.331024 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-7ac9cb57-393c-4261-8148-1940a07205be admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010513 Oct 27 17:25:18.331520 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 34/67] 10.222.0.36 () {60 vars in 1286 bytes} [Thu Oct 27 17:25:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:25:18.342498 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-f504620e-40c7-4eb0-ba07-03a5152939f3 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:25:18.349374 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-f504620e-40c7-4eb0-ba07-03a5152939f3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010300 Oct 27 17:25:18.349883 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 34/68] 10.222.0.36 () {60 vars in 1283 bytes} [Thu Oct 27 17:25:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:28:18.286109 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-7ac9cb57-393c-4261-8148-1940a07205be admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:28:18.287124 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-7ac9cb57-393c-4261-8148-1940a07205be admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 27 17:28:18.287524 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Oct 27 17:28:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:28:18.429439 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writing DB stats nova_api:SELECT=6 {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:28:18.585362 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-ffff143f-c870-4e05-a511-ee670e7396fb admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:28:18.590042 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-ffff143f-c870-4e05-a511-ee670e7396fb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:28:18.590506 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-ffff143f-c870-4e05-a511-ee670e7396fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:28:18.590927 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-ffff143f-c870-4e05-a511-ee670e7396fb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:28:18.591631 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-ffff143f-c870-4e05-a511-ee670e7396fb admin admin] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:28:18.592103 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-ffff143f-c870-4e05-a511-ee670e7396fb admin admin] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:28:18.592513 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-ffff143f-c870-4e05-a511-ee670e7396fb admin admin] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:28:18.623917 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-ffff143f-c870-4e05-a511-ee670e7396fb admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.195666 Oct 27 17:28:18.624465 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 35/70] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Oct 27 17:28:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:28:19.680905 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-7ac9cb57-393c-4261-8148-1940a07205be admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:28:19.681914 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-7ac9cb57-393c-4261-8148-1940a07205be admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Oct 27 17:28:19.682311 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 36/71] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Oct 27 17:28:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:28:19.869697 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-1c034f81-d81c-45a3-9ab7-bf539d872f73 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:28:19.873139 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-1c034f81-d81c-45a3-9ab7-bf539d872f73 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:28:19.873602 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-1c034f81-d81c-45a3-9ab7-bf539d872f73 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:28:19.874022 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-1c034f81-d81c-45a3-9ab7-bf539d872f73 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:28:19.874722 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-1c034f81-d81c-45a3-9ab7-bf539d872f73 admin admin] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:28:19.875166 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-1c034f81-d81c-45a3-9ab7-bf539d872f73 admin admin] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:28:19.875572 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-1c034f81-d81c-45a3-9ab7-bf539d872f73 admin admin] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:28:19.895404 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-1c034f81-d81c-45a3-9ab7-bf539d872f73 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076114 Oct 27 17:28:19.895962 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 36/72] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Oct 27 17:28:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:28:31.369383 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-7ac9cb57-393c-4261-8148-1940a07205be admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:28:31.370380 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-7ac9cb57-393c-4261-8148-1940a07205be admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001703 Oct 27 17:28:31.370791 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 37/73] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Oct 27 17:28:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:28:31.514164 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writing DB stats nova_cell0:SELECT=4 {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:28:31.514876 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writing DB stats nova_cell1:SELECT=4 {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:28:31.515506 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG dbcounter [-] [103798] Writing DB stats nova_api:SELECT=8 {{(pid=103798) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:28:31.562845 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-ad29caf3-94b6-4920-964f-70b93ac57666 admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:28:31.566210 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-ad29caf3-94b6-4920-964f-70b93ac57666 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:28:31.567205 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-ad29caf3-94b6-4920-964f-70b93ac57666 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:28:31.567626 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-ad29caf3-94b6-4920-964f-70b93ac57666 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:28:31.568351 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-ad29caf3-94b6-4920-964f-70b93ac57666 admin admin] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:28:31.568784 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-ad29caf3-94b6-4920-964f-70b93ac57666 admin admin] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:28:31.569191 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-ad29caf3-94b6-4920-964f-70b93ac57666 admin admin] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:28:31.594388 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-ad29caf3-94b6-4920-964f-70b93ac57666 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.084586 Oct 27 17:28:31.594939 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 37/74] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Oct 27 17:28:31 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:28:32.654294 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG nova.api.openstack.wsgi [None req-7ac9cb57-393c-4261-8148-1940a07205be admin admin] Calling method '>' {{(pid=103797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:28:32.655294 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: INFO nova.api.openstack.requestlog [None req-7ac9cb57-393c-4261-8148-1940a07205be admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 27 17:28:32.655687 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: [pid: 103797|app: 0|req: 38/75] 10.222.0.36 () {56 vars in 1074 bytes} [Thu Oct 27 17:28:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:28:32.845254 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG nova.api.openstack.wsgi [None req-9ac07791-9713-4e37-9a29-2de3098102ed admin admin] Calling method '>' {{(pid=103798) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:28:32.849326 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-9ac07791-9713-4e37-9a29-2de3098102ed admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:28:32.849798 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-9ac07791-9713-4e37-9a29-2de3098102ed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:28:32.850258 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-9ac07791-9713-4e37-9a29-2de3098102ed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:28:32.850967 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-9ac07791-9713-4e37-9a29-2de3098102ed admin admin] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:28:32.851413 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-9ac07791-9713-4e37-9a29-2de3098102ed admin admin] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:28:32.851857 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: DEBUG oslo_concurrency.lockutils [None req-9ac07791-9713-4e37-9a29-2de3098102ed admin admin] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103798) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:28:32.873690 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: INFO nova.api.openstack.requestlog [None req-9ac07791-9713-4e37-9a29-2de3098102ed admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079064 Oct 27 17:28:32.874237 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: [pid: 103798|app: 0|req: 38/76] 10.222.0.36 () {60 vars in 1193 bytes} [Thu Oct 27 17:28:32 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:29:30.168916 dv-cinder-862831-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 27 17:29:30.169536 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: Thu Oct 27 17:29:30 2022 - graceful shutdown triggered... Oct 27 17:29:30.169997 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: Gracefully killing worker 1 (pid: 103797)... Oct 27 17:29:30.170358 dv-cinder-862831-1-iscsi devstack@n-api.service[103798]: Gracefully killing worker 2 (pid: 103798)... Oct 27 17:29:30.295797 dv-cinder-862831-1-iscsi devstack@n-api.service[103797]: DEBUG dbcounter [-] [103797] Writing DB stats nova_api:SELECT=4 {{(pid=103797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:29:31.170666 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: worker 1 buried after 1 seconds Oct 27 17:29:31.170666 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: worker 2 buried after 1 seconds Oct 27 17:29:31.171301 dv-cinder-862831-1-iscsi devstack@n-api.service[103796]: goodbye to uWSGI. Oct 27 17:29:31.172312 dv-cinder-862831-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 27 17:29:31.172868 dv-cinder-862831-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 27 17:29:31.175559 dv-cinder-862831-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 17:29:31.194843 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 17:29:31.196839 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 17:29:31 2022] *** Oct 27 17:29:31.196839 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 17:29:31.196839 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 17:29:31.196839 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: nodename: dv-cinder-862831-1-iscsi Oct 27 17:29:31.196839 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: machine: x86_64 Oct 27 17:29:31.196839 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: clock source: unix Oct 27 17:29:31.196839 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: pcre jit disabled Oct 27 17:29:31.196839 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: detected number of CPU cores: 4 Oct 27 17:29:31.196839 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: current working directory: / Oct 27 17:29:31.196839 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: detected binary path: /usr/bin/uwsgi-core Oct 27 17:29:31.197611 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: your processes number limit is 47680 Oct 27 17:29:31.197611 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: your memory page size is 4096 bytes Oct 27 17:29:31.197611 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: detected max file descriptor number: 2048 Oct 27 17:29:31.197611 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: lock engine: pthread robust mutexes Oct 27 17:29:31.197611 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: thunder lock: enabled Oct 27 17:29:31.197611 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 17:29:31.197611 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 17:29:31.236637 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: Python main interpreter initialized at 0x55d2f44259c0 Oct 27 17:29:31.236637 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: python threads support enabled Oct 27 17:29:31.236637 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: your server socket listen backlog is limited to 100 connections Oct 27 17:29:31.236637 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: your mercy for graceful operations on workers is 90 seconds Oct 27 17:29:31.237073 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 17:29:31.237073 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: *** Operational MODE: preforking *** Oct 27 17:29:31.237351 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: *** uWSGI is running in multiple interpreter mode *** Oct 27 17:29:31.237351 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: spawned uWSGI master process (pid: 119024) Oct 27 17:29:31.237565 dv-cinder-862831-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 27 17:29:31.238191 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: spawned uWSGI worker 1 (pid: 119046, cores: 1) Oct 27 17:29:31.242569 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: spawned uWSGI worker 2 (pid: 119047, cores: 1) Oct 27 17:29:31.242569 dv-cinder-862831-1-iscsi devstack@n-api.service[119024]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 17:29:31.898836 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 17:29:31.899404 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 17:29:33.145283 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 17:29:33.145283 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: from cryptography.utils import int_from_bytes Oct 27 17:29:33.146009 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 17:29:33.146009 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: from cryptography.utils import int_from_bytes Oct 27 17:29:33.146164 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 17:29:33.146164 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: from cryptography.utils import int_from_bytes Oct 27 17:29:33.146555 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 17:29:33.146555 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: from cryptography.utils import int_from_bytes Oct 27 17:29:35.578717 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 17:29:35.579167 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 17:29:35.579520 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 17:29:35.579915 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 17:29:35.580176 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 17:29:35.580569 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.580900 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.581226 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.581552 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.581885 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.582201 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.582524 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.582848 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.582960 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 17:29:35.583313 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.583428 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 17:29:35.583514 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.584329 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 17:29:35.584509 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.584660 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862831-1-iscsi {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.584807 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 17:29:35.584959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 17:29:35.585097 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.585267 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.585410 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.585583 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.585749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.585888 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.586018 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.586207 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.586357 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.586534 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.586681 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.586844 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.587014 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.587154 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.587350 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.587508 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.587895 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.588036 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.588165 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.588290 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.588412 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.588536 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.588916 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862831-1-iscsi {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.589129 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.589274 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.589404 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.589541 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.589679 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.589818 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.589960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.590097 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.590238 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.590381 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.590512 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.590768 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.590904 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.591047 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862831-1-iscsi {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.591740 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.591923 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.592055 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.592195 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.592334 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.592473 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.592603 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.592730 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.592867 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.593005 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.593137 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.593266 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.593394 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.593536 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.593675 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.593812 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.593949 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.594090 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.594222 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.594362 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.594501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.594641 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.594778 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862831-1-iscsi {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.594916 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.595125 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.595259 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.595429 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.595568 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.595699 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.595875 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.596056 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.596199 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.596373 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.596512 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.596681 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.596831 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.597056 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.597191 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.597323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.597470 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.597673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.597837 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.597969 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.598098 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.598233 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.598378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.598508 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.598656 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.598793 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.598932 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.599068 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.599221 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.599931 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.600067 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.600204 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.600344 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.600487 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.600643 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.600793 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.600954 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.601088 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.601265 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.601426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.601655 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.601802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.601943 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.602080 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.602218 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.602359 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.602501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.602640 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.602770 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.602901 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.603045 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.603177 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.603315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.603454 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.603585 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.603792 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.603939 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.604096 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.604229 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.604459 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.604593 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.604723 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.604866 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.605007 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.605186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.605328 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.605504 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.605647 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.605817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.605962 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.606131 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.606272 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.606442 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.606587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.606767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.606902 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.607128 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.607517 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.607673 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.607908 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.608053 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.608193 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.608331 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.608462 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.608648 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.608783 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.608930 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.609060 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.609189 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.609326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.609467 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.609597 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.609790 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.610112 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.610250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.610389 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.610526 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.610700 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.610841 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.611003 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.611158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.611302 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.611473 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.611637 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.611883 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.612031 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.612176 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.612315 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.612453 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.612595 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.612778 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.612940 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.613073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.613211 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.613341 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.613479 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.613609 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.613738 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.613913 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.614049 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.614236 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.614381 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.614548 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.614682 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.614882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.615020 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.615195 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.615338 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.615500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.615648 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.615831 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.615965 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.616139 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.616283 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.616450 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.616599 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.616739 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.616875 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.617057 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.617206 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.617414 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.617557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.617696 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.617827 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.618063 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.618198 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.618328 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.618466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.618596 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.618732 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.618862 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.618998 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.619128 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.619270 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.619438 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.619580 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.619783 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.619930 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.620099 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.620234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.620407 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.620554 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.620699 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.620837 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.621013 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.621148 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.621322 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.621466 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.621630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.621773 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.621999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.622149 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.622281 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.622421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.622560 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.622700 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.622839 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.622968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.623139 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.623351 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.623495 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.623624 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.623867 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.624005 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.624145 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.624283 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.624413 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.624544 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.624681 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.624810 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.624971 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.625106 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.625279 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.625414 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.625588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.625733 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.625880 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.626011 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.626268 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.626410 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.626547 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.626691 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.626831 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.626969 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.627099 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.627228 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.627462 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.627616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.627770 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.627902 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.628046 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.628241 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.628371 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.628512 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.628650 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.628781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.628937 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 17:29:35.629079 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.629274 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.629421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.629613 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.629758 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.629959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.630100 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.630279 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.630450 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.630630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.630762 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.630958 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.631100 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.631408 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.631553 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.631726 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.631874 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.632018 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.632245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.632387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.632537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.632669 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.632807 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.632947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.633077 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.633205 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.633348 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.633487 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.633618 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.633747 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.633875 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.634058 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.634209 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.634379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.634514 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.634697 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.634833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.635019 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.635163 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.635333 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.635467 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.635655 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.635837 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.635988 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.636134 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.636313 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.636448 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.636628 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.636760 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.636938 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.637079 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.637254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.637388 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.637612 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.637762 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.637904 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.638035 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.638201 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.638413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.638556 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.638695 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.638834 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.638970 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.639137 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.639279 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.639455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.639602 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.639797 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.639932 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.640112 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.640256 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.640424 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.640566 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.640739 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.640879 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.641053 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.641194 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.641361 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.641510 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.641959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.642095 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.642242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.642456 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.642456 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.642714 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.642714 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.642982 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.642982 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.643403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.643542 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.643683 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.643683 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.643981 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.643981 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.644236 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.644376 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.644520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.644651 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.644788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.644918 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.645037 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.645179 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.645309 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.645438 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.645576 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.645707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.645843 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.645986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.646631 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.646772 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.646912 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.647043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.647179 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.647323 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.647461 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.647755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.647912 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.648054 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.648194 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.648326 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.648532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.648666 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.648802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.648931 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.649069 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.649189 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.649315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.649486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.649628 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.649800 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.650013 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.650151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.650279 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.650406 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.650541 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.650711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.650855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.651021 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.651166 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.651351 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.651493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.651667 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.651860 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.652002 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.652143 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.652315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.652464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.652685 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.652820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.652959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.653096 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.653234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.653364 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.653528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.653672 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.653834 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.653975 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.654143 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.654289 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.654453 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.654600 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.654761 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.654901 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.655072 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.655214 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.655382 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.655525 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.655693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.655866 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.656025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.656170 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.656353 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.656496 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.656668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.656803 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.656979 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.657124 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.657289 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.657425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.657596 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.657728 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.657948 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.658094 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.658233 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.658364 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.658492 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.658699 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.658846 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.658986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.659119 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.659247 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.659383 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.659521 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.659683 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.659874 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.660016 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.660147 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.660313 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.660447 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.660642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.660808 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.660948 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.661079 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.661255 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.661398 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.661564 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.661748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.662407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.662551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.662707 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.662934 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.663069 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.663206 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.663339 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.663468 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.663680 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.663857 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.664045 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.664185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.664370 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.664505 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.664690 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.664833 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.665006 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.665146 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.665327 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.665463 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.665642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.665787 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.665958 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.666093 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.666274 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.666410 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.666589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.666725 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.666903 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.667036 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.667218 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.667358 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.667530 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.667664 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.667869 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.668083 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.668225 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.668354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.668494 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.668625 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.668840 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.668973 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.669102 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.669231 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.669415 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.669558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.669730 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.669873 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.670053 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.670196 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.670365 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.670500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.670685 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.670818 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.670999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.671141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.671322 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.671457 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.671637 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.671816 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.671980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.672126 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.672293 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.672426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.672608 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.672752 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.672990 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.673149 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.673281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.673418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.673548 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.673685 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.673824 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.673965 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.674119 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.674253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.674439 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.674582 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.674752 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.674889 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.675057 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.675190 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.675363 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.675497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.675682 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.675848 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.676019 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.676154 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.676329 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.676471 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.676639 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.676774 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.676954 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.677096 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.677267 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.677421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.677606 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.677741 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.677925 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.678076 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.678282 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.678427 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.678558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.678695 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.678847 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.679040 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.679173 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.679378 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.679511 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.679649 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.679846 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.679978 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.680116 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.680257 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.680377 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.680513 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.680651 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.680787 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.680925 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.681066 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.681234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.681376 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.681547 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.681688 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.681871 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.682015 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.682183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.682316 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.682498 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.682632 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.682813 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.682948 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.683100 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.683319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.683454 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.683584 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.683746 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.683880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.684027 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.684167 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.684328 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.684471 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.684635 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.684777 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.684942 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.685077 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.685272 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.685405 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.685582 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.685723 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.685889 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.686024 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.686200 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.686425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.686569 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.686701 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.686830 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.686966 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.687105 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.687249 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.687417 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.687551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.687764 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.688019 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.688155 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.688387 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.688530 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.688668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.688799 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.688979 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.689196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.689339 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.689470 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.689610 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.689758 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.689890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.690029 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.690202 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.690344 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.690515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.690658 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.690830 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.690964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.691144 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.691278 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.691452 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.691587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.691789 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.691924 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.692111 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.692282 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.692434 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.692679 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.692815 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.693031 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.693167 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.693401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.693553 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.693686 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.693824 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.693963 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.694102 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.694233 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.694372 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.694537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.694673 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.694856 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.694992 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.695167 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.695309 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.695482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.695617 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.695809 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.695948 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.696130 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.696266 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.696445 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.696591 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.696756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.696900 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.697063 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.697202 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.697369 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.697516 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.697678 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.697811 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.697991 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.698126 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.698304 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.698463 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.698672 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.698815 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.698957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.699089 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.699293 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.699441 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.699580 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.699730 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.699875 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.700008 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.700145 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.700287 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.700417 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.700547 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.700737 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.700872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.701078 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.701212 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.701350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.701490 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.701629 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.701761 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.701931 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.702076 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.702280 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.702416 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.702592 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.702734 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.702907 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.703040 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.703212 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.703355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.703582 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.703745 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.703893 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.704032 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.704163 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.704294 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.704452 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.704596 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.704761 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.704906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.705070 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.705204 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.705385 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.705530 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.705697 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.705831 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.706003 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.706138 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.706314 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.706466 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.706605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.706746 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.706924 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.707059 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.707234 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.707381 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.707609 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.707813 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.707957 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.708088 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.708228 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.708366 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.708498 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.709244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.709467 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.709604 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.709745 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.709876 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.710006 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.710142 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.710273 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.710402 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.710547 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.710687 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.710818 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.710957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.711098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.711237 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.711382 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.711514 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.711689 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.711847 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.712038 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.712185 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.712404 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.712614 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.712757 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.712898 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.713039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.713171 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.713310 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.713441 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.713570 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.713811 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.713962 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.714095 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.714225 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.714353 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.714482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.714612 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.714757 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.714888 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.715018 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.715156 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.715287 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.715425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.715593 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.715758 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.715943 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.716079 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.716258 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.716413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.716558 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.716691 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.716868 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.717004 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.717175 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.717325 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.717519 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.717663 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.717824 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.717958 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.718196 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.718344 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.718483 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.718614 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.718752 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.718885 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.719023 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.719183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.719399 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.719619 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.719785 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.719939 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.720082 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.720214 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.720343 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.720480 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.720611 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.720741 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.720878 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.721018 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.721155 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.721285 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.721415 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.721545 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.721685 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.721819 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.722034 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.722171 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.722342 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.722477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.722705 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.722841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.723016 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.723153 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.723334 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.723479 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.723658 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.723839 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.724060 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.724259 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.724426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.724570 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.724702 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.724955 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.725102 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.725288 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.725512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.725663 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.725907 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.726048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.726224 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.726487 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.726614 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.726817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.726961 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.727136 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.727277 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.727413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.727544 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.727751 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.727889 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.728071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.728216 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.728379 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.728524 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.728706 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.728848 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.729017 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.729151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.729326 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.729562 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.729781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.729923 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.730055 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.730184 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.730321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.730468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.730607 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.730746 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.730877 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.731152 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.731286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.731467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.731604 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.731805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.731953 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.732123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.732670 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.732811 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.732953 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.733085 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.733216 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.733346 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.733485 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.733627 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.733770 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.733922 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.734072 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.734298 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.734448 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.734589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.734722 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.734852 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.734991 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.735134 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.735275 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.735415 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.735555 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.735688 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.735892 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.736027 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.736167 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.736314 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.736491 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.736802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.736970 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.737115 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.737298 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.737442 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.737624 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.737769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.737941 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.738094 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.738263 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.738398 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.738584 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.738718 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.738914 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.739058 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.739238 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.739373 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.739596 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.739763 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.740571 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.740718 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.740851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.740983 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.741121 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.741253 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.741424 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.741569 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.741736 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.741872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.742049 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.742193 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.742365 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.742502 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.742697 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.742840 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.743009 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.743146 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.743320 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.743456 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.743630 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.743863 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.744014 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.744150 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.744295 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.744507 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.744643 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.744787 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.744993 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.745138 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.745310 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.745445 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.745622 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.745768 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.746039 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.746176 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.746354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.746488 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.746669 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.746819 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.746995 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.747137 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.747321 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.747456 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.747629 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.747799 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.747966 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.748102 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.748283 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.748439 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.748593 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.748748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.748905 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.749041 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.749234 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.749374 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.749545 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.749696 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.749896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.750031 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.750171 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.750302 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.750465 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.750662 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.750796 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.750927 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.751066 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.751276 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.751428 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.751614 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.751803 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.751996 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.752129 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.752315 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.752466 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.752641 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.752785 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.752966 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.753110 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.753278 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.753415 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.753605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.753750 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.753914 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.754050 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.754220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.754354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.754589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.754744 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.754885 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.755024 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.755165 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.755305 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.755482 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.756140 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.756347 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.756494 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.756671 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.756814 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.756985 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.757133 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.757297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.757444 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.757608 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.757754 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.757937 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.758073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.758247 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.758392 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.758567 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.758701 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.758882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.759023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.759209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.759359 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.759520 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.759654 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.759845 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.760062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.760198 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.760413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.760555 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.760702 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.760898 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.761040 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.761182 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.761315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.761453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.761585 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.761715 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.761846 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.761987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.762134 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.762266 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.762404 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.762558 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.762702 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.762870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.763016 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.763199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.763335 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.763515 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.763657 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.763850 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.763997 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.764162 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.764298 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.764471 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.764616 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.764851 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.764995 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.765130 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.765269 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.765437 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.765587 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.765747 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.765896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.766065 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.766202 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.766379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.766524 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.766692 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.766828 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.767007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.767146 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.767323 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.767467 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.767635 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.767804 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.767971 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.768107 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.768283 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.768422 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.768598 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.768733 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.768913 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.769056 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.769231 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.769375 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.769550 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.769685 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.769862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.770102 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.770334 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.770471 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.770602 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.770741 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.770889 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.771106 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.771251 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.771386 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.771517 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.771661 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.771829 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.772000 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.772138 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.772319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.772457 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.772634 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.772770 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.772950 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.773134 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.773289 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.773442 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.773622 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.773757 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.773947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.774084 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.774269 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.774404 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.774584 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.774733 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.774963 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.775106 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.775239 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.775412 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.775562 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.775730 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.775879 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.776101 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.776246 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.776437 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.776588 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.776739 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.776879 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.777059 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.777205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.777377 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.777529 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.777697 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.777841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.778015 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.778151 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.778327 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.778475 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.778638 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.778782 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.778952 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.779095 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.779265 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.779413 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.779576 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.779780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.779915 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.780047 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.780212 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.780415 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.780558 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.780690 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.780860 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.781005 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.781226 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.781362 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.781501 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.781633 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.781773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.781907 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.782100 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.782245 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.782519 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.782665 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.782834 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.782981 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.783152 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.783288 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.783469 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.783606 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.783810 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.783967 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.784128 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.784264 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.784442 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.784579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.784759 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.784904 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.785070 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.785294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.785438 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.785578 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.785724 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.785865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.785999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.786138 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.786270 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.786401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.786588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.786751 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.786949 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.787095 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.787272 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.787406 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.787587 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.787768 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.787903 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.788067 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.788234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.788444 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.788758 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.788895 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.789077 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.789213 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.789420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.789565 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.789748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.789888 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.790072 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.790209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.790462 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.790623 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.790765 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.790897 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.791027 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.791157 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.791365 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.791514 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.791652 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.791815 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.791956 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.792089 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.792234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.792368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.792506 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.792639 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.792831 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.792968 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.793144 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.793286 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.793447 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.793581 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.793758 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.793893 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.794066 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.794223 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.794397 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.794601 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.794739 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.794958 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.795094 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.795350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.795497 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.795639 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.795806 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.795951 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.796084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.796215 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.796345 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.796508 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.796646 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.796818 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.796956 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.797135 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.797280 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.797445 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.797582 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.797759 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.797909 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.798067 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.798212 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.798376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.798510 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.798687 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.798831 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.799003 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.799139 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.799318 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.799535 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.799671 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.799853 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.799993 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.800133 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.800265 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.800411 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.800559 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.800758 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.800900 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.801031 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.801163 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.801303 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.801509 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.801652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.801794 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.801934 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.802078 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.802225 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.802858 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.803001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.803135 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.803443 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.803592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.803782 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.803935 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.804095 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.804231 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.804411 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.804556 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.804721 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.804865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.805039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.805185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.805347 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.805587 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.805722 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.805853 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.805984 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.806122 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.806254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.806392 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.806573 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.806718 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.806886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.807022 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.807198 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.807334 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.807509 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.807651 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.807840 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.807972 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.808144 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.808281 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.808457 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.808601 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.808768 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.808911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.809079 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.809215 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.809453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.809697 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.809833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.810007 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.810151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.810316 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.810451 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.810631 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.810781 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.810995 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.811141 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.811282 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.811413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.811626 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.811777 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.811931 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.812066 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.812199 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.812331 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.812519 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.812671 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.812833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.812968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.813146 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.813284 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.813455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.813599 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.813766 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.813907 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.814079 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.814214 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.814391 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.814535 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.814697 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.814838 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.815006 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.815140 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.815317 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.815462 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.815690 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.815930 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.816073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.816207 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.816348 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.816482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.816613 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.816744 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.816883 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.817023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.817191 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.817336 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.817515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.817659 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.817838 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.818021 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.818735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.818873 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.819058 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.819194 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.819377 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.819542 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.819685 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.819871 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.820025 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.820173 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.820340 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.820499 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.820661 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.820804 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.821023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.821165 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.821308 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.821455 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.821611 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.821817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.821954 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.822084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.822225 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.822357 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.822487 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.822626 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.822759 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.822920 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.823071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.823234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.823378 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.823559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.823699 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.823911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.824063 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.824227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.824364 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.824552 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.824688 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.824855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.824999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.825164 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.825300 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.825470 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.825614 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.825771 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.825994 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.826132 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.826264 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.826395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.826535 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.826675 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.826808 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.826948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.827080 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.827237 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.827372 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.827542 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.827687 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.827902 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.828041 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.828241 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.828390 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.828546 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.828689 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.828860 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.829006 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.829168 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.829388 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.829523 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.829661 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.829793 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.829931 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.830063 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.830203 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.830367 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.830504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.830674 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.830811 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.830981 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.831139 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.831349 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.831494 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.831634 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.831800 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.832015 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.832153 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.832284 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.832415 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.832545 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.832684 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.832830 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.832964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.833105 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.833239 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.833369 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.833500 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.833670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.833832 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.833969 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.834144 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.834290 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.834475 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.834619 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.834799 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.834943 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.835124 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.835260 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.835445 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.835590 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.835783 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.835919 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.836155 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.836300 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.836449 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.836583 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.836714 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.836845 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.837011 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.837147 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.837328 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.837465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.837643 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.837780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.837966 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.838118 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.838282 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.838427 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.838596 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.838730 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.838911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.839063 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.839223 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.839360 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.839537 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.839678 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.839908 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.840061 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.840222 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.840364 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.840539 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.840682 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.840868 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.841012 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.841191 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.841342 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.841554 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.841690 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.841832 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.841979 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.842173 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.842307 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.842448 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.842581 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.842727 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.842860 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.843042 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.843186 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.843318 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 17:29:35.843462 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.843656 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.844110 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.844433 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.844748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.845063 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.845384 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.845705 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.846039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.846372 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.846683 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.847014 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.847344 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.847695 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.848039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.848385 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.848719 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.849040 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.849380 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.849692 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 17:29:35.849944 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 17:29:35.905719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO dbcounter [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] Registered counter for database nova_api Oct 27 17:29:35.912250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO dbcounter [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] Registered counter for database nova_api Oct 27 17:29:35.925745 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_db.sqlalchemy.engines [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 17:29:35.932375 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_db.sqlalchemy.engines [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 17:29:35.933235 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writer thread running {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 17:29:35.939017 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writer thread running {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 17:29:35.991326 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.context [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9e2082a-7e53-41e4-a8a5-142e829788d7(cell1) {{(pid=119046) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 17:29:35.995394 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:29:35.995906 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:29:35.996288 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.context [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9e2082a-7e53-41e4-a8a5-142e829788d7(cell1) {{(pid=119047) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 17:29:35.997486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:29:35.998209 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:29:35.998671 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:29:36.000308 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:29:36.000695 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:29:36.000804 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:29:36.002349 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:29:36.002708 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO dbcounter [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] Registered counter for database nova_cell0 Oct 27 17:29:36.003071 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:29:36.003518 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:29:36.005594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:29:36.006972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO dbcounter [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] Registered counter for database nova_cell1 Oct 27 17:29:36.007623 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO dbcounter [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] Registered counter for database nova_cell0 Oct 27 17:29:36.012215 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO dbcounter [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] Registered counter for database nova_cell1 Oct 27 17:29:36.014697 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_db.sqlalchemy.engines [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 17:29:36.017681 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_db.sqlalchemy.engines [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 17:29:36.019912 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_db.sqlalchemy.engines [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 17:29:36.022038 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writer thread running {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 17:29:36.022162 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_db.sqlalchemy.engines [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 17:29:36.026028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writer thread running {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 17:29:36.162557 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writer thread running {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 17:29:36.168384 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writer thread running {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 17:29:36.171666 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO dbcounter [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] Registered counter for database nova_cell0 Oct 27 17:29:36.177032 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO dbcounter [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] Registered counter for database nova_cell0 Oct 27 17:29:36.179181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_db.sqlalchemy.engines [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 17:29:36.184556 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writer thread running {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 17:29:36.184734 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_db.sqlalchemy.engines [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 17:29:36.189183 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writer thread running {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 17:29:36.510347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: WARNING keystonemiddleware.auth_token [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 17:29:36.510751 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: WARNING keystonemiddleware.auth_token [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 17:29:36.517977 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: WARNING keystonemiddleware.auth_token [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 17:29:36.518309 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: WARNING keystonemiddleware.auth_token [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 17:29:36.872919 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: WARNING keystonemiddleware.auth_token [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 17:29:36.874231 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: WARNING keystonemiddleware.auth_token [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 17:29:36.878847 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: WARNING keystonemiddleware.auth_token [None req-c1371c66-5fea-48d3-ad42-a48b47c59746 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 17:29:36.880253 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: WARNING keystonemiddleware.auth_token [None req-8eb98b19-cee4-4f14-8447-5d55a6db92d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 17:29:36.884697 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d2f44259c0 pid: 119047 (default app) Oct 27 17:29:36.886105 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d2f44259c0 pid: 119046 (default app) Oct 27 17:30:12.979691 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=3 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:30:12.980847 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=3 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:30:12.981723 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=3 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:30:12.983144 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=3 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:30:14.355121 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=3 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:30:14.355958 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=3 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:30:14.356920 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=3 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:30:14.358366 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=3 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:30:14.603178 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b4407c15-8d86-4e78-a353-154b9a4da7e1 tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] Calling method '.version_select at 0x7f07896c6d30>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:14.928976 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0df3d312-7e3f-4dc9-9ade-a7db351e7c2c tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] Action: 'create', calling method: .version_select at 0x7f07896deee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-687038458", "metadata": {"Type": "work"}}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:30:15.135112 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b4407c15-8d86-4e78-a353-154b9a4da7e1 tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/8fc09bff-1fd5-460e-a0ff-d285c7373ed9" status: 200 len: 350 microversion: 2.1 time: 0.788641 Oct 27 17:30:15.135970 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 1/1] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Oct 27 17:30:14 2022] GET /compute/v2.1/os-volumes/8fc09bff-1fd5-460e-a0ff-d285c7373ed9 => generated 350 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:30:16.006486 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0df3d312-7e3f-4dc9-9ade-a7db351e7c2c tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.040282 Oct 27 17:30:16.016380 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 1/2] 10.222.0.36 () {60 vars in 1156 bytes} [Thu Oct 27 17:30:12 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3043 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 17:30:16.026283 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7ca58e08-0e16-4f7f-9700-db34fb0d5b9b tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] Calling method '.version_select at 0x7f078959bd30>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:16.091057 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7ca58e08-0e16-4f7f-9700-db34fb0d5b9b tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/fd7498e6-5232-4fd8-bd09-43d8815fff81" status: 200 len: 352 microversion: 2.1 time: 0.070717 Oct 27 17:30:16.091669 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Oct 27 17:30:16 2022] GET /compute/v2.1/os-volumes/fd7498e6-5232-4fd8-bd09-43d8815fff81 => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:30:17.107599 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-482c783a-f4cb-48ca-8c13-e0b680748792 tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] Calling method '.version_select at 0x7f0789564d30>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:17.222733 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-482c783a-f4cb-48ca-8c13-e0b680748792 tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/fd7498e6-5232-4fd8-bd09-43d8815fff81" status: 200 len: 353 microversion: 2.1 time: 0.120545 Oct 27 17:30:17.223553 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Oct 27 17:30:17 2022] GET /compute/v2.1/os-volumes/fd7498e6-5232-4fd8-bd09-43d8815fff81 => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:30:17.239181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d9a85368-0d24-41bb-b2cd-5ef95c026b21 tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] Calling method '.version_select at 0x7f07895574c0>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:17.487554 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d9a85368-0d24-41bb-b2cd-5ef95c026b21 tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/fd7498e6-5232-4fd8-bd09-43d8815fff81" status: 200 len: 353 microversion: 2.1 time: 0.253558 Oct 27 17:30:17.488378 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 3/5] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Oct 27 17:30:17 2022] GET /compute/v2.1/os-volumes/fd7498e6-5232-4fd8-bd09-43d8815fff81 => generated 353 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:30:17.514821 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8eca3f37-67d9-4f14-9be0-f9b12e508ea6 tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] Calling method '.version_select at 0x7f07894f94c0>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:17.622807 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8eca3f37-67d9-4f14-9be0-f9b12e508ea6 tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/fd7498e6-5232-4fd8-bd09-43d8815fff81" status: 202 len: 0 microversion: 2.1 time: 0.113360 Oct 27 17:30:17.623449 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 3/6] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Oct 27 17:30:17 2022] DELETE /compute/v2.1/os-volumes/fd7498e6-5232-4fd8-bd09-43d8815fff81 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 17:30:17.633060 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f47ee920-24c2-4e07-99e1-ee581b4af3ee tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] Calling method '.version_select at 0x7f0789557b80>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:17.713420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f72fd60b-bad1-44aa-873f-af64db37024b tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] Calling method '.version_select at 0x7f07894f9b80>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:17.718383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f47ee920-24c2-4e07-99e1-ee581b4af3ee tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/fd7498e6-5232-4fd8-bd09-43d8815fff81" status: 200 len: 352 microversion: 2.1 time: 0.090417 Oct 27 17:30:17.719469 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Oct 27 17:30:17 2022] GET /compute/v2.1/os-volumes/fd7498e6-5232-4fd8-bd09-43d8815fff81 => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:30:17.830156 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f72fd60b-bad1-44aa-873f-af64db37024b tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/835da6b6-dc9f-4365-b4c6-442d1e8f195d" status: 200 len: 350 microversion: 2.1 time: 0.123746 Oct 27 17:30:17.830936 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Oct 27 17:30:17 2022] GET /compute/v2.1/os-volumes/835da6b6-dc9f-4365-b4c6-442d1e8f195d => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:30:18.737680 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-22fcbaa1-6fb4-40fe-828a-bd9ace015fb7 tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] Calling method '.version_select at 0x7f078959bca0>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:18.808180 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-22fcbaa1-6fb4-40fe-828a-bd9ace015fb7 tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] HTTP exception thrown: Volume fd7498e6-5232-4fd8-bd09-43d8815fff81 could not be found. Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-22fcbaa1-6fb4-40fe-828a-bd9ace015fb7 tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] Request method failure captured: Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: GET /compute/v2.1/os-volumes/fd7498e6-5232-4fd8-bd09-43d8815fff81 HTTP/1.1 Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsAkkFlHeGT76vE_ZtI-CQiIxWg9-L_AXMHbfq2Lz1WS1nQ77UGOr5buApKdUXR9vLKklNW1i4NjKLss7EuOdTzZWse0vbDj4nlFiSpxH7LIWu6ul7NOyQPm7yV92r-RVA_2r2NV9o01ed957cF3rbkOp8gHQFAieRVnskdooWsD4dA Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: fa16415761274da5b8bd03dd0c3e761b Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-VolumesGetTestJSON-888204923 Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:30:18.813395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:30:18.814820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fa16415761274da5b8bd03dd0c3e761b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa16415761274da5b8bd03dd0c3e761b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fa16415761274da5b8bd03dd0c3e761b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fa16415761274da5b8bd03dd0c3e761b"}]}] Oct 27 17:30:18.814820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-VolumesGetTestJSON-888204923 Oct 27 17:30:18.814820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: fa16415761274da5b8bd03dd0c3e761b Oct 27 17:30:18.814820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-VolumesGetTestJSON-888204923 Oct 27 17:30:18.814820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-VolumesGetTestJSON-888204923-project Oct 27 17:30:18.814820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:30:18.814820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:30:18.814820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 40046f2d3f5d4e268b4ca47b77a83a92 Oct 27 17:30:18.814820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-VolumesGetTestJSON-888204923-project Oct 27 17:30:18.814820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: Oct 27 17:30:18.814820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Volume fd7498e6-5232-4fd8-bd09-43d8815fff81 could not be found. Oct 27 17:30:18.814820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': 'fd7498e6-5232-4fd8-bd09-43d8815fff81'} Oct 27 17:30:18.814820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fd7498e6-5232-4fd8-bd09-43d8815fff81 could not be found. (HTTP 404) (Request-ID: req-0dafe5e9-22ff-44ef-bcad-71166defe137) Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:18.815673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 17:30:18.816896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fd7498e6-5232-4fd8-bd09-43d8815fff81 could not be found. Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 17:30:18.818045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:30:18.819185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fd7498e6-5232-4fd8-bd09-43d8815fff81 could not be found. Oct 27 17:30:18.819185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:18.819185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:18.819185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:18.819185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:18.819185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:30:18.819185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:30:18.819185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:30:18.819185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:30:18.819185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fd7498e6-5232-4fd8-bd09-43d8815fff81 could not be found. Oct 27 17:30:18.819185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:18.821981 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-22fcbaa1-6fb4-40fe-828a-bd9ace015fb7 tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] Returning 404 to user: Volume fd7498e6-5232-4fd8-bd09-43d8815fff81 could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:30:18.823230 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-22fcbaa1-6fb4-40fe-828a-bd9ace015fb7 tempest-VolumesGetTestJSON-888204923 tempest-VolumesGetTestJSON-888204923-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/fd7498e6-5232-4fd8-bd09-43d8815fff81" status: 404 len: 109 microversion: 2.1 time: 0.093476 Oct 27 17:30:18.824095 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 5/9] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Oct 27 17:30:18 2022] GET /compute/v2.1/os-volumes/fd7498e6-5232-4fd8-bd09-43d8815fff81 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:30:19.383657 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-9568edc8-4094-4c8e-aa6d-16912828fd2d tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] Calling method '.version_select at 0x7f0789564ca0>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:19.477696 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-9568edc8-4094-4c8e-aa6d-16912828fd2d tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/defaea4a-a615-498b-90cc-c02d68860719" status: 200 len: 351 microversion: 2.1 time: 0.098995 Oct 27 17:30:19.479106 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 5/10] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Oct 27 17:30:19 2022] GET /compute/v2.1/os-volumes/defaea4a-a615-498b-90cc-c02d68860719 => generated 351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:30:19.493913 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0b27651e-3996-4e77-91c0-75257eca3491 tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] Calling method '.version_select at 0x7f0789d38af0>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:19.653124 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0b27651e-3996-4e77-91c0-75257eca3491 tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.164011 Oct 27 17:30:19.654008 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 6/11] 10.222.0.36 () {58 vars in 1134 bytes} [Thu Oct 27 17:30:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:19.669156 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5b8a0d20-d99e-497a-903c-da4fad407ec9 tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] Calling method '.version_select at 0x7f07894f98b0>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:19.778108 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5b8a0d20-d99e-497a-903c-da4fad407ec9 tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.113094 Oct 27 17:30:19.779212 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1149 bytes} [Thu Oct 27 17:30:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:30:19.795263 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a2f8feb0-8c1d-441d-99a6-55b5e315121e tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] Calling method '.version_select at 0x7f07894cf160>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:19.951071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a2f8feb0-8c1d-441d-99a6-55b5e315121e tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.161388 Oct 27 17:30:19.951866 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1134 bytes} [Thu Oct 27 17:30:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:19.965557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-75ae8426-e9a9-4ff0-b9fa-98edf954c8ed tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] Calling method '.version_select at 0x7f0789502790>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:20.168759 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-75ae8426-e9a9-4ff0-b9fa-98edf954c8ed tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.207239 Oct 27 17:30:20.173316 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 7/14] 10.222.0.36 () {58 vars in 1167 bytes} [Thu Oct 27 17:30:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:30:20.194055 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-eb03a5f0-e492-48b2-9a48-6e4ed480f6e2 tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] Calling method '.version_select at 0x7f0789557160>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:20.416255 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-eb03a5f0-e492-48b2-9a48-6e4ed480f6e2 tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.234858 Oct 27 17:30:20.417280 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 8/15] 10.222.0.36 () {58 vars in 1170 bytes} [Thu Oct 27 17:30:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:30:20.433572 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-28eca397-feed-4f27-a56c-98b40ef88462 tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] Calling method '.version_select at 0x7f0789ee5310>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:20.629463 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-28eca397-feed-4f27-a56c-98b40ef88462 tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.200288 Oct 27 17:30:20.630584 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1155 bytes} [Thu Oct 27 17:30:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:20.646347 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a133d2a2-c5a9-4c47-8f36-0004f5c0b1f9 tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] Calling method '.version_select at 0x7f07894d8160>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:20.868452 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a133d2a2-c5a9-4c47-8f36-0004f5c0b1f9 tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.227343 Oct 27 17:30:20.869068 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 9/17] 10.222.0.36 () {58 vars in 1188 bytes} [Thu Oct 27 17:30:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:30:20.883665 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-18e5bac6-64b4-492a-8e59-fd82c4a10bee tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] Calling method '.version_select at 0x7f0789564d30>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:21.032737 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-18e5bac6-64b4-492a-8e59-fd82c4a10bee tempest-VolumesTestJSON-852603881 tempest-VolumesTestJSON-852603881-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.153858 Oct 27 17:30:21.033368 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 9/18] 10.222.0.36 () {58 vars in 1155 bytes} [Thu Oct 27 17:30:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:28.770775 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-abe5d7bc-b9b5-467c-9df3-893eb16f6783 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Action: 'create', calling method: .version_select at 0x7f07894d88b0>, body: {"keypair": {"name": "tempest-keypair-1950584043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8f7ZE0mMh3FceWzLpij+Vr6HTfTsHZtMQusfK6pCNNBFgbEea5fQhVgc4Ua0LRAsqj2YSfHtJaWg9IYqQagh3tgV/7P5H+8lWflTwJ2I/DcC0jo8K4VJl4a+Lq/K2E1g=="}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:30:29.032411 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-abe5d7bc-b9b5-467c-9df3-893eb16f6783 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Getting quotas for project 48c1b56e78014b57918f3c4b7ed32114. Resources: {'key_pairs'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:30:29.063954 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-abe5d7bc-b9b5-467c-9df3-893eb16f6783 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Getting quotas for user 1d8ef8bb0fa645048c6389bd1402c471 and project 48c1b56e78014b57918f3c4b7ed32114. Resources: {'key_pairs'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:30:29.303330 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-abe5d7bc-b9b5-467c-9df3-893eb16f6783 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.842970 Oct 27 17:30:29.309111 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 10/19] 10.222.0.36 () {62 vars in 1200 bytes} [Thu Oct 27 17:30:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 849 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 17:30:31.473083 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-71df6dd6-9a3a-49ca-a0b9-c5ec5831107b tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Action: 'create', calling method: .version_select at 0x7f078950f3a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-740709928", "metadata": {"Type": "work"}}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-71df6dd6-9a3a-49ca-a0b9-c5ec5831107b tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Request method failure captured: Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 121 Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA2N72-KavhK0PfMsWjZACYWHU2xQ-YhwczGoTcTfOV_eQcYxemOdr5fE4sehONskfkKQT3PtC8UZgvB47T6LKB7NREhRBpzW3h6w9PeMD2--NhDe2oNbYutlCVTL6hlz9ppwgKbS_9tgh-bQDyFP1M_mSTl8WvX_ZRZbvav4dqKL4 Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: 5050d22773ea46469b414867a77a6343 Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:30:31.492242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:30:31.493660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5050d22773ea46469b414867a77a6343"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5050d22773ea46469b414867a77a6343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5050d22773ea46469b414867a77a6343"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5050d22773ea46469b414867a77a6343"}]}] Oct 27 17:30:31.493660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.493660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: 5050d22773ea46469b414867a77a6343 Oct 27 17:30:31.493660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.493660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-VolumesNegativeTest-1884748876-project Oct 27 17:30:31.493660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:30:31.493660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:30:31.493660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: e3c1c105289543a290898c5f49fa040a Oct 27 17:30:31.493660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-VolumesNegativeTest-1884748876-project Oct 27 17:30:31.493660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Oct 27 17:30:31.493660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-740709928", "metadata": {"Type": "work"}}} Oct 27 17:30:31.493660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: Oct 27 17:30:31.493660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-740709928', 'metadata': {'Type': 'work'}}}} Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise error Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi '#$%' Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:30:31.494497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 17:30:31.496307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 17:30:31.497642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 17:30:31.497642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.499598 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-71df6dd6-9a3a-49ca-a0b9-c5ec5831107b tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:30:31.526912 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-71df6dd6-9a3a-49ca-a0b9-c5ec5831107b tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.395676 Oct 27 17:30:31.526912 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 10/20] 10.222.0.36 () {60 vars in 1156 bytes} [Thu Oct 27 17:30:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 399 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 17:30:31.530839 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3e67361a-fc20-49c5-97d7-7333887d0596 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Action: 'create', calling method: .version_select at 0x7f0789429c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-605998498", "metadata": {"Type": "work"}}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3e67361a-fc20-49c5-97d7-7333887d0596 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Request method failure captured: Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 119 Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA2N72-KavhK0PfMsWjZACYWHU2xQ-YhwczGoTcTfOV_eQcYxemOdr5fE4sehONskfkKQT3PtC8UZgvB47T6LKB7NREhRBpzW3h6w9PeMD2--NhDe2oNbYutlCVTL6hlz9ppwgKbS_9tgh-bQDyFP1M_mSTl8WvX_ZRZbvav4dqKL4 Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: 5050d22773ea46469b414867a77a6343 Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:30:31.534477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:30:31.537482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5050d22773ea46469b414867a77a6343"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5050d22773ea46469b414867a77a6343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5050d22773ea46469b414867a77a6343"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5050d22773ea46469b414867a77a6343"}]}] Oct 27 17:30:31.537482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.537482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: 5050d22773ea46469b414867a77a6343 Oct 27 17:30:31.537482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.537482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-VolumesNegativeTest-1884748876-project Oct 27 17:30:31.537482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:30:31.537482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:30:31.537482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: e3c1c105289543a290898c5f49fa040a Oct 27 17:30:31.537482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-VolumesNegativeTest-1884748876-project Oct 27 17:30:31.537482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Oct 27 17:30:31.537482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-605998498", "metadata": {"Type": "work"}}} Oct 27 17:30:31.537482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: Oct 27 17:30:31.537482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-605998498', 'metadata': {'Type': 'work'}}}} Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise error Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi '0' Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:30:31.538120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 17:30:31.546199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 17:30:31.565752 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 17:30:31.565752 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.565752 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3e67361a-fc20-49c5-97d7-7333887d0596 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:30:31.565752 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-3e67361a-fc20-49c5-97d7-7333887d0596 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024267 Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-934535e3-2fd5-4a18-ad0e-134c44595843 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Action: 'create', calling method: .version_select at 0x7f07894f95e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-790339931", "metadata": {"Type": "work"}}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-934535e3-2fd5-4a18-ad0e-134c44595843 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Request method failure captured: Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 118 Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA2N72-KavhK0PfMsWjZACYWHU2xQ-YhwczGoTcTfOV_eQcYxemOdr5fE4sehONskfkKQT3PtC8UZgvB47T6LKB7NREhRBpzW3h6w9PeMD2--NhDe2oNbYutlCVTL6hlz9ppwgKbS_9tgh-bQDyFP1M_mSTl8WvX_ZRZbvav4dqKL4 Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: 5050d22773ea46469b414867a77a6343 Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:30:31.568068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:30:31.570532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5050d22773ea46469b414867a77a6343"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5050d22773ea46469b414867a77a6343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5050d22773ea46469b414867a77a6343"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5050d22773ea46469b414867a77a6343"}]}] Oct 27 17:30:31.570532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.570532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: 5050d22773ea46469b414867a77a6343 Oct 27 17:30:31.570532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.570532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-VolumesNegativeTest-1884748876-project Oct 27 17:30:31.570532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:30:31.570532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:30:31.570532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: e3c1c105289543a290898c5f49fa040a Oct 27 17:30:31.570532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-VolumesNegativeTest-1884748876-project Oct 27 17:30:31.570532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Oct 27 17:30:31.570532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-790339931", "metadata": {"Type": "work"}}} Oct 27 17:30:31.570532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: Oct 27 17:30:31.570532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-790339931', 'metadata': {'Type': 'work'}}}} Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise error Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi '' Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:30:31.571755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 17:30:31.578389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 17:30:31.581201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 17:30:31.581201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.581201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-934535e3-2fd5-4a18-ad0e-134c44595843 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:30:31.581201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-934535e3-2fd5-4a18-ad0e-134c44595843 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017897 Oct 27 17:30:31.581201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 11/21] 10.222.0.36 () {60 vars in 1156 bytes} [Thu Oct 27 17:30:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 17:30:31.582605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 11/22] 10.222.0.36 () {60 vars in 1156 bytes} [Thu Oct 27 17:30:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 17:30:31.596674 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ce9d5a5f-3a85-43a9-95c8-83b53e96a373 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Calling method '.version_select at 0x7f0789ee5430>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:31.669434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-ce9d5a5f-3a85-43a9-95c8-83b53e96a373 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] HTTP exception thrown: Volume tempest-invalid-145081617 could not be found. Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ce9d5a5f-3a85-43a9-95c8-83b53e96a373 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Request method failure captured: Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-145081617 HTTP/1.1 Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA2N72-KavhK0PfMsWjZACYWHU2xQ-YhwczGoTcTfOV_eQcYxemOdr5fE4sehONskfkKQT3PtC8UZgvB47T6LKB7NREhRBpzW3h6w9PeMD2--NhDe2oNbYutlCVTL6hlz9ppwgKbS_9tgh-bQDyFP1M_mSTl8WvX_ZRZbvav4dqKL4 Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: 5050d22773ea46469b414867a77a6343 Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:30:31.678387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:30:31.679558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5050d22773ea46469b414867a77a6343"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5050d22773ea46469b414867a77a6343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5050d22773ea46469b414867a77a6343"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5050d22773ea46469b414867a77a6343"}]}] Oct 27 17:30:31.679558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.679558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: 5050d22773ea46469b414867a77a6343 Oct 27 17:30:31.679558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.679558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-VolumesNegativeTest-1884748876-project Oct 27 17:30:31.679558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:30:31.679558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:30:31.679558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: e3c1c105289543a290898c5f49fa040a Oct 27 17:30:31.679558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-VolumesNegativeTest-1884748876-project Oct 27 17:30:31.679558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: Oct 27 17:30:31.679558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Volume tempest-invalid-145081617 could not be found. Oct 27 17:30:31.679558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': 'tempest-invalid-145081617'} Oct 27 17:30:31.679558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-145081617 could not be found. (HTTP 404) (Request-ID: req-e3c423ac-17c2-4ff0-a21a-9431c24d46fb) Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:31.680420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 17:30:31.682749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-145081617 could not be found. Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:30:31.685250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-145081617 could not be found. Oct 27 17:30:31.690600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.690600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:31.690600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.690600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.690600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:30:31.690600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:30:31.690600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:30:31.690600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:30:31.690600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-145081617 could not be found. Oct 27 17:30:31.690600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.694132 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ce9d5a5f-3a85-43a9-95c8-83b53e96a373 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Returning 404 to user: Volume tempest-invalid-145081617 could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:30:31.695226 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-ce9d5a5f-3a85-43a9-95c8-83b53e96a373 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-145081617" status: 404 len: 98 microversion: 2.1 time: 0.122086 Oct 27 17:30:31.696436 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 12/23] 10.222.0.36 () {58 vars in 1215 bytes} [Thu Oct 27 17:30:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-145081617 => generated 98 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 17:30:31.708614 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-78b26f13-8332-412f-ac48-373f0de5e7de tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005023 Oct 27 17:30:31.709806 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 12/24] 10.222.0.36 () {58 vars in 1140 bytes} [Thu Oct 27 17:30:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 17:30:31.722561 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8c3727fc-a5f6-48be-a6ba-b960a16a6939 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004502 Oct 27 17:30:31.724740 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 13/25] 10.222.0.36 () {58 vars in 1137 bytes} [Thu Oct 27 17:30:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 17:30:31.735629 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-1ca2ddc4-0203-424b-b2e3-5297668fe4a6 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Calling method '.version_select at 0x7f078945de50>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:31.803641 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-1ca2ddc4-0203-424b-b2e3-5297668fe4a6 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] HTTP exception thrown: Volume 014f22f0-851e-4b12-a784-20fa70175f67 could not be found. Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-1ca2ddc4-0203-424b-b2e3-5297668fe4a6 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Request method failure captured: Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: DELETE /compute/v2.1/os-volumes/014f22f0-851e-4b12-a784-20fa70175f67 HTTP/1.1 Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA2N72-KavhK0PfMsWjZACYWHU2xQ-YhwczGoTcTfOV_eQcYxemOdr5fE4sehONskfkKQT3PtC8UZgvB47T6LKB7NREhRBpzW3h6w9PeMD2--NhDe2oNbYutlCVTL6hlz9ppwgKbS_9tgh-bQDyFP1M_mSTl8WvX_ZRZbvav4dqKL4 Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: 5050d22773ea46469b414867a77a6343 Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:30:31.805756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:30:31.806972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5050d22773ea46469b414867a77a6343"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5050d22773ea46469b414867a77a6343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5050d22773ea46469b414867a77a6343"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5050d22773ea46469b414867a77a6343"}]}] Oct 27 17:30:31.806972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.806972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: 5050d22773ea46469b414867a77a6343 Oct 27 17:30:31.806972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.806972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-VolumesNegativeTest-1884748876-project Oct 27 17:30:31.806972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:30:31.806972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:30:31.806972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: e3c1c105289543a290898c5f49fa040a Oct 27 17:30:31.806972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-VolumesNegativeTest-1884748876-project Oct 27 17:30:31.806972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: Oct 27 17:30:31.806972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Volume 014f22f0-851e-4b12-a784-20fa70175f67 could not be found. Oct 27 17:30:31.806972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '014f22f0-851e-4b12-a784-20fa70175f67'} Oct 27 17:30:31.806972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 014f22f0-851e-4b12-a784-20fa70175f67 could not be found. (HTTP 404) (Request-ID: req-86316c63-160a-4fcb-a8c2-db746460aad7) Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:31.807781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 17:30:31.808886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 014f22f0-851e-4b12-a784-20fa70175f67 could not be found. Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 17:30:31.810025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:30:31.811069 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 014f22f0-851e-4b12-a784-20fa70175f67 could not be found. Oct 27 17:30:31.811069 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.811069 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:31.811069 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.811069 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.811069 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:30:31.811069 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:30:31.811069 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:30:31.811069 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:30:31.811069 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 014f22f0-851e-4b12-a784-20fa70175f67 could not be found. Oct 27 17:30:31.811069 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.811069 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-1ca2ddc4-0203-424b-b2e3-5297668fe4a6 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Returning 404 to user: Volume 014f22f0-851e-4b12-a784-20fa70175f67 could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:30:31.811069 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-1ca2ddc4-0203-424b-b2e3-5297668fe4a6 tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/014f22f0-851e-4b12-a784-20fa70175f67" status: 404 len: 109 microversion: 2.1 time: 0.078364 Oct 27 17:30:31.816365 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 13/26] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Oct 27 17:30:31 2022] DELETE /compute/v2.1/os-volumes/014f22f0-851e-4b12-a784-20fa70175f67 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:30:31.821765 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-18f5b8e5-a73f-4221-aeaf-1e9e061c572c tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Calling method '.version_select at 0x7f078950fc10>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:31.880441 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-18f5b8e5-a73f-4221-aeaf-1e9e061c572c tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] HTTP exception thrown: Volume abd4519b-612f-4ae6-a6bd-6fd628cfcdaf could not be found. Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-18f5b8e5-a73f-4221-aeaf-1e9e061c572c tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Request method failure captured: Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/os-volumes/abd4519b-612f-4ae6-a6bd-6fd628cfcdaf HTTP/1.1 Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA2N72-KavhK0PfMsWjZACYWHU2xQ-YhwczGoTcTfOV_eQcYxemOdr5fE4sehONskfkKQT3PtC8UZgvB47T6LKB7NREhRBpzW3h6w9PeMD2--NhDe2oNbYutlCVTL6hlz9ppwgKbS_9tgh-bQDyFP1M_mSTl8WvX_ZRZbvav4dqKL4 Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: 5050d22773ea46469b414867a77a6343 Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:30:31.882906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:30:31.884113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5050d22773ea46469b414867a77a6343"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5050d22773ea46469b414867a77a6343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5050d22773ea46469b414867a77a6343"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5050d22773ea46469b414867a77a6343"}]}] Oct 27 17:30:31.884113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.884113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: 5050d22773ea46469b414867a77a6343 Oct 27 17:30:31.884113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-VolumesNegativeTest-1884748876 Oct 27 17:30:31.884113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-VolumesNegativeTest-1884748876-project Oct 27 17:30:31.884113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:30:31.884113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:30:31.884113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: e3c1c105289543a290898c5f49fa040a Oct 27 17:30:31.884113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-VolumesNegativeTest-1884748876-project Oct 27 17:30:31.884113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: Oct 27 17:30:31.884113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Volume abd4519b-612f-4ae6-a6bd-6fd628cfcdaf could not be found. Oct 27 17:30:31.884113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': 'abd4519b-612f-4ae6-a6bd-6fd628cfcdaf'} Oct 27 17:30:31.884113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume abd4519b-612f-4ae6-a6bd-6fd628cfcdaf could not be found. (HTTP 404) (Request-ID: req-11b622f5-ab33-49e4-9941-6ceaeecd7558) Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:31.884717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 17:30:31.885589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume abd4519b-612f-4ae6-a6bd-6fd628cfcdaf could not be found. Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 17:30:31.886557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:30:31.887423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume abd4519b-612f-4ae6-a6bd-6fd628cfcdaf could not be found. Oct 27 17:30:31.887423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.887423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:30:31.887423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.887423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:30:31.887423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:30:31.887423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:30:31.887423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:30:31.887423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:30:31.887423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume abd4519b-612f-4ae6-a6bd-6fd628cfcdaf could not be found. Oct 27 17:30:31.887423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:30:31.889514 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-18f5b8e5-a73f-4221-aeaf-1e9e061c572c tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] Returning 404 to user: Volume abd4519b-612f-4ae6-a6bd-6fd628cfcdaf could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:30:31.890716 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-18f5b8e5-a73f-4221-aeaf-1e9e061c572c tempest-VolumesNegativeTest-1884748876 tempest-VolumesNegativeTest-1884748876-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/abd4519b-612f-4ae6-a6bd-6fd628cfcdaf" status: 404 len: 109 microversion: 2.1 time: 0.073619 Oct 27 17:30:31.892050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 14/27] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Oct 27 17:30:31 2022] GET /compute/v2.1/os-volumes/abd4519b-612f-4ae6-a6bd-6fd628cfcdaf => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:30:32.869108 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a55357a8-a437-46b0-8654-cf04fbfb1d38 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Action: 'create', calling method: .version_select at 0x7f07894d8af0>, body: {"keypair": {"name": "tempest-keypair-1378676002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAvNTj7Yb3XjMDATP4uyTMWsZ+Og/VtwDO38VxmoaiRlEpbQCXIuLoxQuEYL7+2+/gX5MEbAb4CwW45Ffa/pOG4DfUkJy5JUa6e2SdEzFz/GTFHg+FafEoBz4OqQ7RX/w=="}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:30:32.935276 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-a55357a8-a437-46b0-8654-cf04fbfb1d38 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Getting quotas for project a9d4d4a323694c4c9244df4f17342a35. Resources: {'key_pairs'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:30:32.954329 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-3272f3f0-389d-4d56-bc11-b7e49cf1d465 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Action: 'create', calling method: .version_select at 0x7f078950fdc0>, body: {"keypair": {"name": "tempest-keypair-243853759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIuCNZ6R7gBKTFBWJ75M78Nemq9HhrWShxn6ZcP1DaG0UaGRx+Fp5k733ordcwx5Jfjkg9Jl8upaAGEVOGU2v6Kp6NhJrLdPmr5BBSdJcBbVfi2yMWaWl71HvLrBnPO7Q=="}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:30:32.955244 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-a55357a8-a437-46b0-8654-cf04fbfb1d38 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Getting quotas for user 5477ed4bd13542e48263f08761a7ff03 and project a9d4d4a323694c4c9244df4f17342a35. Resources: {'key_pairs'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:30:33.103291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a55357a8-a437-46b0-8654-cf04fbfb1d38 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.957530 Oct 27 17:30:33.111250 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 14/28] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Oct 27 17:30:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:30:33.268415 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-3272f3f0-389d-4d56-bc11-b7e49cf1d465 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Getting quotas for project a35c2b53ccb445d4b0dd2915376f69cf. Resources: {'key_pairs'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:30:33.302854 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-3272f3f0-389d-4d56-bc11-b7e49cf1d465 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Getting quotas for user 3c36ea3a53cc48fa996891e3c6ddfda8 and project a35c2b53ccb445d4b0dd2915376f69cf. Resources: {'key_pairs'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:30:33.620928 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-3272f3f0-389d-4d56-bc11-b7e49cf1d465 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.193153 Oct 27 17:30:33.626345 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 15/29] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Oct 27 17:30:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:30:33.839872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-629877081", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452", "networks": [{"uuid": "d4997daf-43a9-4912-bbef-3879a78a2a93"}]}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:30:34.144272 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.network.neutron [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] validate_networks() for [('d4997daf-43a9-4912-bbef-3879a78a2a93', None, None, None, None, None)] {{(pid=119046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:30:35.565329 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1526796919", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:30:35.824322 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.network.neutron [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] validate_networks() for [('1141f554-a530-4b9e-acf6-75096dad10e5', None, None, None, None, None)] {{(pid=119047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:30:36.733665 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Flavor limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:30:36.734145 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Image limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:30:36.734614 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Flavor pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:30:36.734956 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Image pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:30:36.735361 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:30:36.803623 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:36.804172 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:36.804685 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:36.805412 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:36.805863 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:36.806376 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:36.886638 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Getting quotas for project 32e47ddf4f9e4e6cb6ed56253f708fac. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:30:36.897985 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Getting quotas for user 16ef9c40eb5e48fda12aa9e3b420d97e and project 32e47ddf4f9e4e6cb6ed56253f708fac. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:30:36.930734 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Going to run 1 instances... {{(pid=119046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:30:36.938362 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:30:37.200663 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-17e08183-e048-415f-b6d9-78278d8d6959 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.605027 Oct 27 17:30:37.213845 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 15/30] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:30:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:30:37.240771 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-c56d765d-b94b-4276-9400-b1e3b228e7bc tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:37.242850 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c56d765d-b94b-4276-9400-b1e3b228e7bc tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:37.597907 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Flavor limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:30:37.600486 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Image limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:30:37.601404 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Flavor pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:30:37.602058 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Image pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:30:37.604336 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:30:37.632082 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:37.633369 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:37.634574 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:37.635993 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:37.639903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:37.642265 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:37.710875 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-c56d765d-b94b-4276-9400-b1e3b228e7bc tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:37.752175 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-c56d765d-b94b-4276-9400-b1e3b228e7bc tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1214 microversion: 2.1 time: 0.532402 Oct 27 17:30:37.753778 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Getting quotas for project e29292a8f0184800a931a0cbd8c72bf8. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:30:37.759350 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 16/31] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:37 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1214 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:37.774409 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Getting quotas for user 8c8a2448e10b4ff39adf43a9581cb794 and project e29292a8f0184800a931a0cbd8c72bf8. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:30:37.839077 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Going to run 1 instances... {{(pid=119047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:30:37.851137 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:30:38.190497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-e42fdca6-fd96-4895-ba5d-14d77f3bc24a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.766661 Oct 27 17:30:38.191223 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 16/32] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:30:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 2768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:30:38.206897 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-1becbca4-1b46-45d2-9367-6de1111d8d98 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:38.208306 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-1becbca4-1b46-45d2-9367-6de1111d8d98 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:38.296881 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1becbca4-1b46-45d2-9367-6de1111d8d98 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:38.306177 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-1becbca4-1b46-45d2-9367-6de1111d8d98 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1222 microversion: 2.1 time: 0.104655 Oct 27 17:30:38.307991 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 17/33] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:38 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:38.463927 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1107379093", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "421d9227-c86b-4ebb-ad1d-0e58ea3c13fb"}], "security_groups": [{"name": "tempest-securitygroup--1720443230"}], "key_name": "tempest-keypair-1950584043", "user_data": "}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:30:38.704323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1940364574", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:30:38.875077 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.network.neutron [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] validate_networks() for [('1141f554-a530-4b9e-acf6-75096dad10e5', None, None, None, None, None)] {{(pid=119046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:30:39.212761 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.network.neutron [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] validate_networks() for [('421d9227-c86b-4ebb-ad1d-0e58ea3c13fb', None, None, None, None, None)] {{(pid=119047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:30:41.501664 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Flavor limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:30:41.502645 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Image limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:30:41.503371 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Flavor pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:30:41.503961 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Image pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:30:41.505037 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:30:41.521205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:41.524060 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:41.524678 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:41.525559 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:41.526155 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:41.528214 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:41.570901 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Getting quotas for project e29292a8f0184800a931a0cbd8c72bf8. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:30:41.584068 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Getting quotas for user 8c8a2448e10b4ff39adf43a9581cb794 and project e29292a8f0184800a931a0cbd8c72bf8. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:30:41.609979 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Going to run 1 instances... {{(pid=119046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:30:41.614721 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:30:41.701736 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-c2ff2563-697f-494e-a35d-57723ad1ab9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.019913 Oct 27 17:30:41.704359 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 18/34] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:30:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 3027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:30:41.711455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-35c4edde-7625-4fbd-89e2-c70b82e675a9 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:41.713011 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-35c4edde-7625-4fbd-89e2-c70b82e675a9 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:41.727677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-35c4edde-7625-4fbd-89e2-c70b82e675a9 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:41.728787 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-35c4edde-7625-4fbd-89e2-c70b82e675a9 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:41.729379 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-35c4edde-7625-4fbd-89e2-c70b82e675a9 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:41.734091 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-35c4edde-7625-4fbd-89e2-c70b82e675a9 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:41.736385 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-35c4edde-7625-4fbd-89e2-c70b82e675a9 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:41.737396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-35c4edde-7625-4fbd-89e2-c70b82e675a9 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:42.135620 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-35c4edde-7625-4fbd-89e2-c70b82e675a9 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:42.180937 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-35c4edde-7625-4fbd-89e2-c70b82e675a9 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1210 microversion: 2.1 time: 0.471078 Oct 27 17:30:42.185940 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 19/35] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:41 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1210 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:42.214502 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2132d34d-b9ec-4968-afda-6c62fe89eaf4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:42.215152 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2132d34d-b9ec-4968-afda-6c62fe89eaf4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:42.419628 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2132d34d-b9ec-4968-afda-6c62fe89eaf4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:42.433291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2132d34d-b9ec-4968-afda-6c62fe89eaf4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1222 microversion: 2.1 time: 0.245984 Oct 27 17:30:42.433896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 20/36] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:42 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1222 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:42.438996 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2117395303", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "40b6c3a9-49a5-4aa8-abaa-a41beea7c111"}], "security_groups": [{"name": "tempest-securitygroup--1940078599"}], "key_name": "tempest-keypair-243853759", "user_data": "}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:30:42.619632 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Flavor limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:30:42.620798 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Image limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:30:42.621601 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Flavor pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:30:42.622170 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Image pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:30:42.622797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:30:42.665945 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:42.668448 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:42.671617 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:42.672652 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:42.677173 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:42.678631 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:42.749774 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.network.neutron [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] validate_networks() for [('40b6c3a9-49a5-4aa8-abaa-a41beea7c111', None, None, None, None, None)] {{(pid=119046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:30:42.755323 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Getting quotas for project 48c1b56e78014b57918f3c4b7ed32114. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:30:42.780447 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Getting quotas for user 1d8ef8bb0fa645048c6389bd1402c471 and project 48c1b56e78014b57918f3c4b7ed32114. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:30:42.846644 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Going to run 1 instances... {{(pid=119047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:30:42.849716 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:30:43.070860 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-680d0b0e-3d0b-4512-8aed-5c52e77f2851 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.619051 Oct 27 17:30:43.089627 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 17/37] 10.222.0.36 () {62 vars in 1188 bytes} [Thu Oct 27 17:30:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 4639 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 17:30:43.114745 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-9edf0b8f-4321-486b-9d7a-2b7a5542a464 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:43.126241 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-9edf0b8f-4321-486b-9d7a-2b7a5542a464 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:43.570261 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9edf0b8f-4321-486b-9d7a-2b7a5542a464 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:43.618106 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9edf0b8f-4321-486b-9d7a-2b7a5542a464 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:43.619695 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9edf0b8f-4321-486b-9d7a-2b7a5542a464 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:43.620865 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-9edf0b8f-4321-486b-9d7a-2b7a5542a464 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1282 microversion: 2.20 time: 0.527312 Oct 27 17:30:43.621439 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 18/38] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:30:43 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1282 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:30:43.655994 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-913967001", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ace0e445-53a9-4562-8c1c-1746268e4744"}], "security_groups": [{"name": "tempest-securitygroup--143996261"}], "key_name": "tempest-keypair-1378676002", "user_data": "}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:30:43.951030 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.network.neutron [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] validate_networks() for [('ace0e445-53a9-4562-8c1c-1746268e4744', None, None, None, None, None)] {{(pid=119047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:30:44.923357 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Flavor limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:30:44.923952 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Image limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:30:44.924521 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Flavor pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:30:44.925129 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Image pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:30:44.925696 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:30:44.952241 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:44.953120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:44.953577 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:44.954407 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:44.954921 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:44.959619 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:44.984334 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Getting quotas for project a35c2b53ccb445d4b0dd2915376f69cf. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:30:44.991075 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Getting quotas for user 3c36ea3a53cc48fa996891e3c6ddfda8 and project a35c2b53ccb445d4b0dd2915376f69cf. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:30:45.004978 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Going to run 1 instances... {{(pid=119046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:30:45.010484 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:30:45.117794 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-bc1c1e3e-702e-49f6-b9cb-46b44d0004d4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.682800 Oct 27 17:30:45.118458 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 21/39] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:30:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 2684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:30:45.137752 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0ca1a069-5506-498e-ac87-e79e8c570619 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:45.138394 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-0ca1a069-5506-498e-ac87-e79e8c570619 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:45.169891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0ca1a069-5506-498e-ac87-e79e8c570619 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:45.170393 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0ca1a069-5506-498e-ac87-e79e8c570619 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:45.170833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0ca1a069-5506-498e-ac87-e79e8c570619 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:45.171542 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0ca1a069-5506-498e-ac87-e79e8c570619 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:45.172060 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0ca1a069-5506-498e-ac87-e79e8c570619 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:45.172490 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0ca1a069-5506-498e-ac87-e79e8c570619 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:45.815146 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0ca1a069-5506-498e-ac87-e79e8c570619 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:45.831532 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0ca1a069-5506-498e-ac87-e79e8c570619 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1272 microversion: 2.1 time: 0.709645 Oct 27 17:30:45.857357 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 22/40] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:45 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1272 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:45.862930 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4db95b52-1585-4250-8ec6-b4d38871e543 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:45.868928 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4db95b52-1585-4250-8ec6-b4d38871e543 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:45.889581 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4db95b52-1585-4250-8ec6-b4d38871e543 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:45.893066 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4db95b52-1585-4250-8ec6-b4d38871e543 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:45.893817 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4db95b52-1585-4250-8ec6-b4d38871e543 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:45.898009 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4db95b52-1585-4250-8ec6-b4d38871e543 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:45.899362 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4db95b52-1585-4250-8ec6-b4d38871e543 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:45.901226 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4db95b52-1585-4250-8ec6-b4d38871e543 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:46.065258 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4db95b52-1585-4250-8ec6-b4d38871e543 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:46.076902 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4db95b52-1585-4250-8ec6-b4d38871e543 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1280 microversion: 2.1 time: 0.218313 Oct 27 17:30:46.082246 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 23/41] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:45 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1280 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:46.088966 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-028f4108-04c4-4e55-b91c-85078992369a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:46.092841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-028f4108-04c4-4e55-b91c-85078992369a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:46.111804 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-028f4108-04c4-4e55-b91c-85078992369a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:46.114629 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-028f4108-04c4-4e55-b91c-85078992369a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:46.115362 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-028f4108-04c4-4e55-b91c-85078992369a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:46.116677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-028f4108-04c4-4e55-b91c-85078992369a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:46.118942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-028f4108-04c4-4e55-b91c-85078992369a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:46.119534 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-028f4108-04c4-4e55-b91c-85078992369a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:46.639772 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-028f4108-04c4-4e55-b91c-85078992369a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:46.656162 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-028f4108-04c4-4e55-b91c-85078992369a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:46.656162 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-028f4108-04c4-4e55-b91c-85078992369a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:46.664060 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-028f4108-04c4-4e55-b91c-85078992369a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1334 microversion: 2.20 time: 0.580241 Oct 27 17:30:46.665077 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 24/42] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:30:46 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1334 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:30:46.673758 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-57a388a2-215a-4b68-bffc-9810e62e4acf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:46.675460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-57a388a2-215a-4b68-bffc-9810e62e4acf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:46.697232 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-57a388a2-215a-4b68-bffc-9810e62e4acf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:46.708274 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-57a388a2-215a-4b68-bffc-9810e62e4acf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:46.708928 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-57a388a2-215a-4b68-bffc-9810e62e4acf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:46.709756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-57a388a2-215a-4b68-bffc-9810e62e4acf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:46.710309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-57a388a2-215a-4b68-bffc-9810e62e4acf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:46.710806 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-57a388a2-215a-4b68-bffc-9810e62e4acf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:46.717631 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Flavor limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:30:46.718748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Image limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:30:46.719465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Flavor pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:30:46.720105 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Image pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:30:46.720795 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:30:46.746394 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:46.747197 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:46.747866 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:46.748952 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:46.749668 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:46.750332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:46.820995 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Getting quotas for project a9d4d4a323694c4c9244df4f17342a35. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:30:46.834684 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Getting quotas for user 5477ed4bd13542e48263f08761a7ff03 and project a9d4d4a323694c4c9244df4f17342a35. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:30:46.865638 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Going to run 1 instances... {{(pid=119047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:30:46.872823 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:30:47.037579 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-9b6f8ece-df3e-43cc-8239-06c04b03f703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.406595 Oct 27 17:30:47.045870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 19/43] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:30:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 3415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:30:47.065713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-89cc139b-a489-481e-8a8b-b191ad1902e2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:47.069033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-89cc139b-a489-481e-8a8b-b191ad1902e2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:47.095605 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-89cc139b-a489-481e-8a8b-b191ad1902e2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:47.096704 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-89cc139b-a489-481e-8a8b-b191ad1902e2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:47.099815 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-89cc139b-a489-481e-8a8b-b191ad1902e2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:47.100722 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-89cc139b-a489-481e-8a8b-b191ad1902e2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:47.107474 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-89cc139b-a489-481e-8a8b-b191ad1902e2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:47.108552 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-89cc139b-a489-481e-8a8b-b191ad1902e2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:47.734688 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-89cc139b-a489-481e-8a8b-b191ad1902e2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:47.787290 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-89cc139b-a489-481e-8a8b-b191ad1902e2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1272 microversion: 2.1 time: 0.739992 Oct 27 17:30:47.788097 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 20/44] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:47 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1272 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:47.808090 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-db835f5e-e0c3-4b9b-ae07-43dd0fd82f16 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:47.808781 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-db835f5e-e0c3-4b9b-ae07-43dd0fd82f16 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:47.815428 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-57a388a2-215a-4b68-bffc-9810e62e4acf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:47.839959 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-57a388a2-215a-4b68-bffc-9810e62e4acf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1245 microversion: 2.1 time: 1.167662 Oct 27 17:30:47.842407 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 25/45] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:46 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1245 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:47.860867 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-74196634-7f26-4df4-bfa3-0c70f1e4aa62 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:47.864738 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-74196634-7f26-4df4-bfa3-0c70f1e4aa62 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:47.887002 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74196634-7f26-4df4-bfa3-0c70f1e4aa62 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:47.894004 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74196634-7f26-4df4-bfa3-0c70f1e4aa62 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:47.898876 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74196634-7f26-4df4-bfa3-0c70f1e4aa62 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:47.901694 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74196634-7f26-4df4-bfa3-0c70f1e4aa62 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:47.902106 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74196634-7f26-4df4-bfa3-0c70f1e4aa62 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:47.902555 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74196634-7f26-4df4-bfa3-0c70f1e4aa62 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:48.086087 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-db835f5e-e0c3-4b9b-ae07-43dd0fd82f16 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:48.101304 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-db835f5e-e0c3-4b9b-ae07-43dd0fd82f16 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1237 microversion: 2.1 time: 0.305222 Oct 27 17:30:48.101924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 21/46] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:47 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1237 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:48.151392 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-75c9d517-6911-485d-8df7-68ce60c4c6fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:48.153426 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-75c9d517-6911-485d-8df7-68ce60c4c6fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:48.184430 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75c9d517-6911-485d-8df7-68ce60c4c6fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:48.186179 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75c9d517-6911-485d-8df7-68ce60c4c6fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:48.191226 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75c9d517-6911-485d-8df7-68ce60c4c6fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:48.192638 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75c9d517-6911-485d-8df7-68ce60c4c6fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:48.193123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75c9d517-6911-485d-8df7-68ce60c4c6fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:48.193560 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75c9d517-6911-485d-8df7-68ce60c4c6fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:48.451159 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-74196634-7f26-4df4-bfa3-0c70f1e4aa62 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:48.461800 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-74196634-7f26-4df4-bfa3-0c70f1e4aa62 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1280 microversion: 2.1 time: 0.617686 Oct 27 17:30:48.463798 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 26/47] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:47 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1280 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:48.806407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-75c9d517-6911-485d-8df7-68ce60c4c6fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:48.813389 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d34f3c8e-b1a9-45db-ba16-673d5ae40b56 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:48.814339 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d34f3c8e-b1a9-45db-ba16-673d5ae40b56 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:48.818711 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:30:48.829988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-75c9d517-6911-485d-8df7-68ce60c4c6fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:48.837127 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-75c9d517-6911-485d-8df7-68ce60c4c6fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:48.842576 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-75c9d517-6911-485d-8df7-68ce60c4c6fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1340 microversion: 2.20 time: 0.715787 Oct 27 17:30:48.855020 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 22/48] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:30:48 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1340 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:30:48.861342 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d34f3c8e-b1a9-45db-ba16-673d5ae40b56 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:48.864265 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d34f3c8e-b1a9-45db-ba16-673d5ae40b56 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:48.878005 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d34f3c8e-b1a9-45db-ba16-673d5ae40b56 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:48.879500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-7eb3a164-a5d3-433c-b111-15320d3c4265 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:48.883478 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d34f3c8e-b1a9-45db-ba16-673d5ae40b56 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:48.885135 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-7eb3a164-a5d3-433c-b111-15320d3c4265 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:48.889767 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d34f3c8e-b1a9-45db-ba16-673d5ae40b56 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:48.891929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d34f3c8e-b1a9-45db-ba16-673d5ae40b56 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:48.954723 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7eb3a164-a5d3-433c-b111-15320d3c4265 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:48.962353 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7eb3a164-a5d3-433c-b111-15320d3c4265 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:48.967371 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7eb3a164-a5d3-433c-b111-15320d3c4265 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:48.978556 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7eb3a164-a5d3-433c-b111-15320d3c4265 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:48.981102 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7eb3a164-a5d3-433c-b111-15320d3c4265 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:48.987055 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7eb3a164-a5d3-433c-b111-15320d3c4265 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:49.383569 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7eb3a164-a5d3-433c-b111-15320d3c4265 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:49.413378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-7eb3a164-a5d3-433c-b111-15320d3c4265 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1299 microversion: 2.1 time: 0.547706 Oct 27 17:30:49.413981 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 23/49] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:48 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1299 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:49.430340 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5ba31fd0-bf28-4003-9a65-cb12230f78de tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:49.435923 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-5ba31fd0-bf28-4003-9a65-cb12230f78de tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:49.470540 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5ba31fd0-bf28-4003-9a65-cb12230f78de tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:49.472942 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5ba31fd0-bf28-4003-9a65-cb12230f78de tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:49.475000 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5ba31fd0-bf28-4003-9a65-cb12230f78de tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:49.479354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5ba31fd0-bf28-4003-9a65-cb12230f78de tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:49.481021 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5ba31fd0-bf28-4003-9a65-cb12230f78de tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:49.481584 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5ba31fd0-bf28-4003-9a65-cb12230f78de tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:49.721016 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-5ba31fd0-bf28-4003-9a65-cb12230f78de tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:49.731207 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5ba31fd0-bf28-4003-9a65-cb12230f78de tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1289 microversion: 2.1 time: 0.316114 Oct 27 17:30:49.740113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 24/50] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:49 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1289 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:49.748562 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-edc0e244-2873-4b38-a993-08054e0a4175 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:49.749529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-edc0e244-2873-4b38-a993-08054e0a4175 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:49.752771 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d34f3c8e-b1a9-45db-ba16-673d5ae40b56 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:49.768738 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d34f3c8e-b1a9-45db-ba16-673d5ae40b56 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.958246 Oct 27 17:30:49.781004 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-edc0e244-2873-4b38-a993-08054e0a4175 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:49.782004 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-edc0e244-2873-4b38-a993-08054e0a4175 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:49.782698 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-edc0e244-2873-4b38-a993-08054e0a4175 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:49.786397 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-edc0e244-2873-4b38-a993-08054e0a4175 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:49.787377 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-edc0e244-2873-4b38-a993-08054e0a4175 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:49.788067 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 27/51] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:48 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:49.788774 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-edc0e244-2873-4b38-a993-08054e0a4175 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:49.887105 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-923c6577-1a49-484c-ab71-c8798088bce7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:49.887750 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-923c6577-1a49-484c-ab71-c8798088bce7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:49.906268 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-923c6577-1a49-484c-ab71-c8798088bce7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:49.907077 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-923c6577-1a49-484c-ab71-c8798088bce7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:49.907785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-923c6577-1a49-484c-ab71-c8798088bce7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:49.908736 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-923c6577-1a49-484c-ab71-c8798088bce7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:49.909415 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-923c6577-1a49-484c-ab71-c8798088bce7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:49.910051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-923c6577-1a49-484c-ab71-c8798088bce7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:49.925629 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-edc0e244-2873-4b38-a993-08054e0a4175 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:49.947109 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-edc0e244-2873-4b38-a993-08054e0a4175 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1280 microversion: 2.1 time: 0.205322 Oct 27 17:30:49.947965 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 25/52] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:49 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1280 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:50.454570 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-346e3588-a510-489c-b6db-79a88b6565bc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:50.457006 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-346e3588-a510-489c-b6db-79a88b6565bc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:50.474972 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-346e3588-a510-489c-b6db-79a88b6565bc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:50.477381 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-346e3588-a510-489c-b6db-79a88b6565bc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:50.479256 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-346e3588-a510-489c-b6db-79a88b6565bc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:50.482309 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-346e3588-a510-489c-b6db-79a88b6565bc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:50.483573 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-346e3588-a510-489c-b6db-79a88b6565bc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:50.493795 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-346e3588-a510-489c-b6db-79a88b6565bc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:50.906626 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-923c6577-1a49-484c-ab71-c8798088bce7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:50.926469 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-923c6577-1a49-484c-ab71-c8798088bce7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:50.932924 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-923c6577-1a49-484c-ab71-c8798088bce7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:50.939848 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-923c6577-1a49-484c-ab71-c8798088bce7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1340 microversion: 2.20 time: 1.052954 Oct 27 17:30:50.963872 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-346e3588-a510-489c-b6db-79a88b6565bc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:50.968076 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 28/53] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:30:49 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1340 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:30:50.976071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-807fcb16-2aeb-4e15-b4dc-fdf7420e435c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:50.981164 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-346e3588-a510-489c-b6db-79a88b6565bc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1299 microversion: 2.1 time: 0.544531 Oct 27 17:30:50.982351 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-807fcb16-2aeb-4e15-b4dc-fdf7420e435c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:50.992184 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 26/54] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:50 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1299 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:51.011333 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a5ffbb84-73b2-4ba6-9c76-41b21e91a1bb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:51.012705 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a5ffbb84-73b2-4ba6-9c76-41b21e91a1bb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:51.030355 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-807fcb16-2aeb-4e15-b4dc-fdf7420e435c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:51.030891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-807fcb16-2aeb-4e15-b4dc-fdf7420e435c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:51.031572 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a5ffbb84-73b2-4ba6-9c76-41b21e91a1bb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:51.031692 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-807fcb16-2aeb-4e15-b4dc-fdf7420e435c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:51.032855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a5ffbb84-73b2-4ba6-9c76-41b21e91a1bb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:51.036888 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a5ffbb84-73b2-4ba6-9c76-41b21e91a1bb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:51.037703 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-807fcb16-2aeb-4e15-b4dc-fdf7420e435c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:51.040773 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a5ffbb84-73b2-4ba6-9c76-41b21e91a1bb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:51.041130 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-807fcb16-2aeb-4e15-b4dc-fdf7420e435c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:51.041956 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-807fcb16-2aeb-4e15-b4dc-fdf7420e435c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:51.042839 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a5ffbb84-73b2-4ba6-9c76-41b21e91a1bb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:51.044970 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a5ffbb84-73b2-4ba6-9c76-41b21e91a1bb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:51.527438 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-807fcb16-2aeb-4e15-b4dc-fdf7420e435c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:51.536967 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-807fcb16-2aeb-4e15-b4dc-fdf7420e435c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1295 microversion: 2.1 time: 0.567661 Oct 27 17:30:51.544378 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 29/55] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:50 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1295 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:51.566243 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-66e4ae2c-a25d-4816-bc85-334d023afddc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:51.567436 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-66e4ae2c-a25d-4816-bc85-334d023afddc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:51.597799 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66e4ae2c-a25d-4816-bc85-334d023afddc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:51.601208 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66e4ae2c-a25d-4816-bc85-334d023afddc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:51.601681 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66e4ae2c-a25d-4816-bc85-334d023afddc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:51.606717 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66e4ae2c-a25d-4816-bc85-334d023afddc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:51.609871 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66e4ae2c-a25d-4816-bc85-334d023afddc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:51.611441 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66e4ae2c-a25d-4816-bc85-334d023afddc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:51.905398 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-66e4ae2c-a25d-4816-bc85-334d023afddc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:51.915570 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-66e4ae2c-a25d-4816-bc85-334d023afddc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1280 microversion: 2.1 time: 0.368025 Oct 27 17:30:51.923747 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 30/56] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:51 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1280 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:51.975301 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2e899015-b45c-4048-93a9-f31702144209 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:51.976334 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2e899015-b45c-4048-93a9-f31702144209 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:52.014127 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e899015-b45c-4048-93a9-f31702144209 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:52.014726 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e899015-b45c-4048-93a9-f31702144209 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:52.015217 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e899015-b45c-4048-93a9-f31702144209 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:52.015997 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e899015-b45c-4048-93a9-f31702144209 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:52.016495 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e899015-b45c-4048-93a9-f31702144209 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:52.016921 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e899015-b45c-4048-93a9-f31702144209 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:52.711318 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a5ffbb84-73b2-4ba6-9c76-41b21e91a1bb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:52.724259 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a5ffbb84-73b2-4ba6-9c76-41b21e91a1bb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 1.728412 Oct 27 17:30:52.727051 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 27/57] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:50 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:52.742044 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-bd490607-cd83-43ba-a505-5eb8f0443d12 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:52.748048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-bd490607-cd83-43ba-a505-5eb8f0443d12 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:52.781855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bd490607-cd83-43ba-a505-5eb8f0443d12 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:52.781855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bd490607-cd83-43ba-a505-5eb8f0443d12 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:52.782194 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bd490607-cd83-43ba-a505-5eb8f0443d12 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:52.782950 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bd490607-cd83-43ba-a505-5eb8f0443d12 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:52.783426 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bd490607-cd83-43ba-a505-5eb8f0443d12 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:52.784006 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bd490607-cd83-43ba-a505-5eb8f0443d12 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:52.989545 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-bd490607-cd83-43ba-a505-5eb8f0443d12 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:52.999068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-bd490607-cd83-43ba-a505-5eb8f0443d12 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1299 microversion: 2.1 time: 0.269261 Oct 27 17:30:53.000631 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 28/58] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:52 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1299 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:53.009711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2ee44fac-246c-4b84-aefb-a982a7e1ab54 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:53.012368 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2ee44fac-246c-4b84-aefb-a982a7e1ab54 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:53.018865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2e899015-b45c-4048-93a9-f31702144209 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:53.023292 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ee44fac-246c-4b84-aefb-a982a7e1ab54 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:53.023999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ee44fac-246c-4b84-aefb-a982a7e1ab54 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:53.025299 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ee44fac-246c-4b84-aefb-a982a7e1ab54 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:53.027352 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ee44fac-246c-4b84-aefb-a982a7e1ab54 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:53.028725 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ee44fac-246c-4b84-aefb-a982a7e1ab54 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:53.029559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ee44fac-246c-4b84-aefb-a982a7e1ab54 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:53.032661 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2e899015-b45c-4048-93a9-f31702144209 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:53.034143 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2e899015-b45c-4048-93a9-f31702144209 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:53.035344 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2e899015-b45c-4048-93a9-f31702144209 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1340 microversion: 2.20 time: 1.064517 Oct 27 17:30:53.035948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 31/59] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:30:51 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1340 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:30:53.066221 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8caee37a-53dd-4b85-9e48-0ef47e56bd25 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:53.067137 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8caee37a-53dd-4b85-9e48-0ef47e56bd25 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:53.073815 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8caee37a-53dd-4b85-9e48-0ef47e56bd25 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:53.074590 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8caee37a-53dd-4b85-9e48-0ef47e56bd25 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:53.075177 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8caee37a-53dd-4b85-9e48-0ef47e56bd25 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:53.076079 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8caee37a-53dd-4b85-9e48-0ef47e56bd25 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:53.076756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8caee37a-53dd-4b85-9e48-0ef47e56bd25 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:53.077362 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8caee37a-53dd-4b85-9e48-0ef47e56bd25 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:53.443234 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8caee37a-53dd-4b85-9e48-0ef47e56bd25 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:53.457736 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8caee37a-53dd-4b85-9e48-0ef47e56bd25 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1280 microversion: 2.1 time: 0.402782 Oct 27 17:30:53.460646 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 32/60] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:53 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1280 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:53.767460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b010b491-5cc0-4f7f-9742-a297b0d1ced3 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:53.771504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b010b491-5cc0-4f7f-9742-a297b0d1ced3 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:53.801111 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b010b491-5cc0-4f7f-9742-a297b0d1ced3 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:53.803063 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b010b491-5cc0-4f7f-9742-a297b0d1ced3 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:53.806794 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b010b491-5cc0-4f7f-9742-a297b0d1ced3 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:53.808526 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b010b491-5cc0-4f7f-9742-a297b0d1ced3 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:53.812925 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b010b491-5cc0-4f7f-9742-a297b0d1ced3 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:53.813505 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b010b491-5cc0-4f7f-9742-a297b0d1ced3 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:53.900359 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2ee44fac-246c-4b84-aefb-a982a7e1ab54 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:53.916677 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2ee44fac-246c-4b84-aefb-a982a7e1ab54 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1295 microversion: 2.1 time: 0.914293 Oct 27 17:30:53.920334 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 29/61] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:53 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1295 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:54.028905 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-04cc056b-5a2b-4f0f-8d52-65c9f2f78eff tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:54.031167 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-04cc056b-5a2b-4f0f-8d52-65c9f2f78eff tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:54.062819 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04cc056b-5a2b-4f0f-8d52-65c9f2f78eff tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:54.065356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04cc056b-5a2b-4f0f-8d52-65c9f2f78eff tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:54.066461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04cc056b-5a2b-4f0f-8d52-65c9f2f78eff tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:54.068755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04cc056b-5a2b-4f0f-8d52-65c9f2f78eff tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:54.070217 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04cc056b-5a2b-4f0f-8d52-65c9f2f78eff tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:54.070825 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04cc056b-5a2b-4f0f-8d52-65c9f2f78eff tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:54.671687 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-04cc056b-5a2b-4f0f-8d52-65c9f2f78eff tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:54.682570 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-04cc056b-5a2b-4f0f-8d52-65c9f2f78eff tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1299 microversion: 2.1 time: 0.658572 Oct 27 17:30:54.689587 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 30/62] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:54 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1299 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:30:54.701888 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-be1d1421-9fc4-4abc-92ba-0a9ce76ff92f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:54.706041 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-be1d1421-9fc4-4abc-92ba-0a9ce76ff92f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:54.733044 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-be1d1421-9fc4-4abc-92ba-0a9ce76ff92f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:54.734401 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-be1d1421-9fc4-4abc-92ba-0a9ce76ff92f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:54.736044 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-be1d1421-9fc4-4abc-92ba-0a9ce76ff92f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:54.737132 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-be1d1421-9fc4-4abc-92ba-0a9ce76ff92f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:54.739450 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-be1d1421-9fc4-4abc-92ba-0a9ce76ff92f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:54.740770 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-be1d1421-9fc4-4abc-92ba-0a9ce76ff92f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:54.973375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=6 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:30:55.005483 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=32 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:30:55.610653 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b010b491-5cc0-4f7f-9742-a297b0d1ced3 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:55.624739 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b010b491-5cc0-4f7f-9742-a297b0d1ced3 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 1.875094 Oct 27 17:30:55.644669 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 33/63] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:53 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:55.651310 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-eabd4c39-9e1c-4bd2-b8ee-893ce05978b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:55.652171 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-eabd4c39-9e1c-4bd2-b8ee-893ce05978b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:55.661685 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eabd4c39-9e1c-4bd2-b8ee-893ce05978b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:55.662357 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eabd4c39-9e1c-4bd2-b8ee-893ce05978b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:55.662971 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eabd4c39-9e1c-4bd2-b8ee-893ce05978b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:55.664017 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eabd4c39-9e1c-4bd2-b8ee-893ce05978b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:55.664651 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eabd4c39-9e1c-4bd2-b8ee-893ce05978b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:55.665335 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eabd4c39-9e1c-4bd2-b8ee-893ce05978b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:56.009048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-be1d1421-9fc4-4abc-92ba-0a9ce76ff92f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:56.027738 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-be1d1421-9fc4-4abc-92ba-0a9ce76ff92f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:56.040151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-be1d1421-9fc4-4abc-92ba-0a9ce76ff92f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:56.041568 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-be1d1421-9fc4-4abc-92ba-0a9ce76ff92f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 1.350377 Oct 27 17:30:56.046252 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 31/64] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:30:54 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:30:56.063081 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c3a686bf-c0cd-4ea2-a1db-bee49921be7a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:56.076647 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c3a686bf-c0cd-4ea2-a1db-bee49921be7a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:56.095579 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c3a686bf-c0cd-4ea2-a1db-bee49921be7a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:56.097816 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c3a686bf-c0cd-4ea2-a1db-bee49921be7a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:56.101786 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c3a686bf-c0cd-4ea2-a1db-bee49921be7a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:56.102724 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c3a686bf-c0cd-4ea2-a1db-bee49921be7a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:56.103204 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c3a686bf-c0cd-4ea2-a1db-bee49921be7a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:56.103638 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c3a686bf-c0cd-4ea2-a1db-bee49921be7a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:56.695820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-eabd4c39-9e1c-4bd2-b8ee-893ce05978b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:56.714916 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-eabd4c39-9e1c-4bd2-b8ee-893ce05978b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 1.068783 Oct 27 17:30:56.719853 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 34/65] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:55 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:56.734296 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0951c5c5-f521-48fc-9837-ebc864f9714e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:56.735204 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-0951c5c5-f521-48fc-9837-ebc864f9714e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:56.748437 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0951c5c5-f521-48fc-9837-ebc864f9714e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:56.751382 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0951c5c5-f521-48fc-9837-ebc864f9714e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:56.752944 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0951c5c5-f521-48fc-9837-ebc864f9714e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:56.756600 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0951c5c5-f521-48fc-9837-ebc864f9714e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:56.757752 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0951c5c5-f521-48fc-9837-ebc864f9714e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:56.760618 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0951c5c5-f521-48fc-9837-ebc864f9714e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:56.771634 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=6 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:30:56.862895 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c3a686bf-c0cd-4ea2-a1db-bee49921be7a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:56.873797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c3a686bf-c0cd-4ea2-a1db-bee49921be7a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.825917 Oct 27 17:30:56.895318 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 32/66] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:56 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:56.914590 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d31f6336-91fc-4bb6-bace-35e43c350620 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:56.915559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d31f6336-91fc-4bb6-bace-35e43c350620 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:56.931053 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d31f6336-91fc-4bb6-bace-35e43c350620 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:56.934059 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d31f6336-91fc-4bb6-bace-35e43c350620 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:56.934632 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d31f6336-91fc-4bb6-bace-35e43c350620 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:56.935453 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d31f6336-91fc-4bb6-bace-35e43c350620 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:56.938492 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d31f6336-91fc-4bb6-bace-35e43c350620 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:56.939208 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d31f6336-91fc-4bb6-bace-35e43c350620 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:58.096600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=26 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:30:58.097241 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0951c5c5-f521-48fc-9837-ebc864f9714e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:58.116101 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0951c5c5-f521-48fc-9837-ebc864f9714e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 1.392684 Oct 27 17:30:58.119670 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 35/67] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:56 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:58.130735 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-482978fa-7044-4967-80ca-fc6b21929175 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:58.131358 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-482978fa-7044-4967-80ca-fc6b21929175 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:58.145636 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-482978fa-7044-4967-80ca-fc6b21929175 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:58.147440 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-482978fa-7044-4967-80ca-fc6b21929175 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:58.148857 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-482978fa-7044-4967-80ca-fc6b21929175 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:58.151854 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-482978fa-7044-4967-80ca-fc6b21929175 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:58.153259 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-482978fa-7044-4967-80ca-fc6b21929175 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:58.155276 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-482978fa-7044-4967-80ca-fc6b21929175 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:58.203305 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=100 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:30:58.762914 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d31f6336-91fc-4bb6-bace-35e43c350620 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:58.780882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d31f6336-91fc-4bb6-bace-35e43c350620 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 1.884049 Oct 27 17:30:58.792717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 33/68] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:56 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:58.977598 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-5db42315-5702-4dda-b761-748a865f19fa req-820f69ce-7aea-4fd3-8e0a-a7d0390455c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7238287c-af11-4c20-96cf-8ee9e4b34e8a", "tag": "a9b83ac3-e8af-444b-9748-299c30d1dd1d"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:30:58.996944 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:30:59.000635 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-5db42315-5702-4dda-b761-748a865f19fa req-820f69ce-7aea-4fd3-8e0a-a7d0390455c2 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:59.001264 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-5db42315-5702-4dda-b761-748a865f19fa req-820f69ce-7aea-4fd3-8e0a-a7d0390455c2 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:59.002143 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-5db42315-5702-4dda-b761-748a865f19fa req-820f69ce-7aea-4fd3-8e0a-a7d0390455c2 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:59.032159 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-5db42315-5702-4dda-b761-748a865f19fa req-820f69ce-7aea-4fd3-8e0a-a7d0390455c2 service nova] Creating event network-changed:a9b83ac3-e8af-444b-9748-299c30d1dd1d for instance 7238287c-af11-4c20-96cf-8ee9e4b34e8a on hv-cinder-86283 Oct 27 17:30:59.032882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-5db42315-5702-4dda-b761-748a865f19fa req-820f69ce-7aea-4fd3-8e0a-a7d0390455c2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119047) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 17:30:59.033280 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-5db42315-5702-4dda-b761-748a865f19fa req-820f69ce-7aea-4fd3-8e0a-a7d0390455c2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119047) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 17:30:59.034529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-39f0170a-87d4-4a2c-939d-05373041f81a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:59.035230 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-39f0170a-87d4-4a2c-939d-05373041f81a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:59.035664 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-39f0170a-87d4-4a2c-939d-05373041f81a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:59.036626 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-39f0170a-87d4-4a2c-939d-05373041f81a None None] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:59.037809 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-39f0170a-87d4-4a2c-939d-05373041f81a None None] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:59.038293 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-39f0170a-87d4-4a2c-939d-05373041f81a None None] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:59.052059 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.compute.rpcapi [None req-39f0170a-87d4-4a2c-939d-05373041f81a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 27 17:30:59.053509 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-39f0170a-87d4-4a2c-939d-05373041f81a None None] Releasing lock "compute-rpcapi-router" {{(pid=119047) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 17:30:59.071957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-39f0170a-87d4-4a2c-939d-05373041f81a None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287153 Oct 27 17:30:59.072720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 34/69] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:30:59.118829 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-482978fa-7044-4967-80ca-fc6b21929175 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:59.131768 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-482978fa-7044-4967-80ca-fc6b21929175 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:59.137681 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-482978fa-7044-4967-80ca-fc6b21929175 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:59.144959 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-482978fa-7044-4967-80ca-fc6b21929175 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 1.023358 Oct 27 17:30:59.145656 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 36/70] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:30:58 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:30:59.152811 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2e471862-b7aa-4110-aa06-441574b9eb9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:59.153480 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2e471862-b7aa-4110-aa06-441574b9eb9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:59.163843 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-7260d82d-5f00-4ba6-90f1-36f9111fe6d8 req-7866ec1b-2f4a-4519-be2c-97633428429d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6f4324-0826-4b60-b1b5-a7d00c63cdec", "tag": "dd5472a4-a592-4461-977c-b241c99f30b9"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:30:59.167251 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e471862-b7aa-4110-aa06-441574b9eb9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:59.168376 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e471862-b7aa-4110-aa06-441574b9eb9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:59.169000 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e471862-b7aa-4110-aa06-441574b9eb9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:59.169767 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e471862-b7aa-4110-aa06-441574b9eb9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:59.170680 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e471862-b7aa-4110-aa06-441574b9eb9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:59.171107 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e471862-b7aa-4110-aa06-441574b9eb9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:59.174606 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-7260d82d-5f00-4ba6-90f1-36f9111fe6d8 req-7866ec1b-2f4a-4519-be2c-97633428429d service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:59.175099 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-7260d82d-5f00-4ba6-90f1-36f9111fe6d8 req-7866ec1b-2f4a-4519-be2c-97633428429d service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:59.176098 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-7260d82d-5f00-4ba6-90f1-36f9111fe6d8 req-7866ec1b-2f4a-4519-be2c-97633428429d service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:59.194740 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-7260d82d-5f00-4ba6-90f1-36f9111fe6d8 req-7866ec1b-2f4a-4519-be2c-97633428429d service nova] Creating event network-changed:dd5472a4-a592-4461-977c-b241c99f30b9 for instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec on hv-cinder-86283 Oct 27 17:30:59.202198 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-7260d82d-5f00-4ba6-90f1-36f9111fe6d8 req-7866ec1b-2f4a-4519-be2c-97633428429d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127625 Oct 27 17:30:59.203888 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 35/71] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:30:59.219948 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-84b178cd-84ec-481c-b446-73a15eed41e7 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:59.222649 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-84b178cd-84ec-481c-b446-73a15eed41e7 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:59.231589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84b178cd-84ec-481c-b446-73a15eed41e7 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:59.233351 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84b178cd-84ec-481c-b446-73a15eed41e7 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:59.234089 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84b178cd-84ec-481c-b446-73a15eed41e7 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:59.235007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84b178cd-84ec-481c-b446-73a15eed41e7 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:59.235633 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84b178cd-84ec-481c-b446-73a15eed41e7 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:59.236346 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84b178cd-84ec-481c-b446-73a15eed41e7 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:59.583751 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-84b178cd-84ec-481c-b446-73a15eed41e7 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:59.592875 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-84b178cd-84ec-481c-b446-73a15eed41e7 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.386796 Oct 27 17:30:59.593539 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 36/72] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:59 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:59.613729 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0e183aea-c9a3-4b38-af78-bba79d1deb57 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:59.614420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-0e183aea-c9a3-4b38-af78-bba79d1deb57 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:59.621052 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e183aea-c9a3-4b38-af78-bba79d1deb57 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:59.621644 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e183aea-c9a3-4b38-af78-bba79d1deb57 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:59.622154 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e183aea-c9a3-4b38-af78-bba79d1deb57 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:59.622912 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e183aea-c9a3-4b38-af78-bba79d1deb57 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:59.623434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e183aea-c9a3-4b38-af78-bba79d1deb57 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:59.624047 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e183aea-c9a3-4b38-af78-bba79d1deb57 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:59.643993 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=100 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:30:59.667110 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2e471862-b7aa-4110-aa06-441574b9eb9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:59.676936 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2e471862-b7aa-4110-aa06-441574b9eb9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.529230 Oct 27 17:30:59.679785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 37/73] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:59 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:59.766040 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-0e183aea-c9a3-4b38-af78-bba79d1deb57 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:30:59.774569 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0e183aea-c9a3-4b38-af78-bba79d1deb57 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.164819 Oct 27 17:30:59.775241 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 37/74] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:59 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:30:59.808295 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7f5d4176-2255-4e4c-af0f-85db4c290c75 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:30:59.808995 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7f5d4176-2255-4e4c-af0f-85db4c290c75 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:30:59.814856 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f5d4176-2255-4e4c-af0f-85db4c290c75 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:59.815408 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f5d4176-2255-4e4c-af0f-85db4c290c75 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:59.815984 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f5d4176-2255-4e4c-af0f-85db4c290c75 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:30:59.816799 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f5d4176-2255-4e4c-af0f-85db4c290c75 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:30:59.817329 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f5d4176-2255-4e4c-af0f-85db4c290c75 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:30:59.817820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f5d4176-2255-4e4c-af0f-85db4c290c75 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:00.162983 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7f5d4176-2255-4e4c-af0f-85db4c290c75 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:00.173189 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ee94261e-6270-41a1-8937-57c9fd19f3d4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:00.173874 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-ee94261e-6270-41a1-8937-57c9fd19f3d4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:00.207605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7f5d4176-2255-4e4c-af0f-85db4c290c75 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.400596 Oct 27 17:31:00.208895 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ee94261e-6270-41a1-8937-57c9fd19f3d4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:00.223755 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 38/75] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:30:59 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:00.224414 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ee94261e-6270-41a1-8937-57c9fd19f3d4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:00.224414 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ee94261e-6270-41a1-8937-57c9fd19f3d4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:00.224414 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ee94261e-6270-41a1-8937-57c9fd19f3d4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:00.224414 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ee94261e-6270-41a1-8937-57c9fd19f3d4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:00.224800 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ee94261e-6270-41a1-8937-57c9fd19f3d4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:00.432027 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ee94261e-6270-41a1-8937-57c9fd19f3d4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:00.442691 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ee94261e-6270-41a1-8937-57c9fd19f3d4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:00.444863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ee94261e-6270-41a1-8937-57c9fd19f3d4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:00.446271 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-ee94261e-6270-41a1-8937-57c9fd19f3d4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.278989 Oct 27 17:31:00.447062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 38/76] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:00 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:31:00.617292 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d89c3952-9dd9-4f66-944a-4811cf1f37c2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:00.620894 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d89c3952-9dd9-4f66-944a-4811cf1f37c2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:00.625151 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d89c3952-9dd9-4f66-944a-4811cf1f37c2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:00.625634 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d89c3952-9dd9-4f66-944a-4811cf1f37c2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:00.626064 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d89c3952-9dd9-4f66-944a-4811cf1f37c2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:00.626930 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d89c3952-9dd9-4f66-944a-4811cf1f37c2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:00.627184 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d89c3952-9dd9-4f66-944a-4811cf1f37c2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:00.627647 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d89c3952-9dd9-4f66-944a-4811cf1f37c2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:00.700867 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-72b98ba7-d832-4a56-8a8a-59459115b90e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:00.701750 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-72b98ba7-d832-4a56-8a8a-59459115b90e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:00.709743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-72b98ba7-d832-4a56-8a8a-59459115b90e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:00.710529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-72b98ba7-d832-4a56-8a8a-59459115b90e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:00.711146 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-72b98ba7-d832-4a56-8a8a-59459115b90e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:00.712055 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-72b98ba7-d832-4a56-8a8a-59459115b90e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:00.712649 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-72b98ba7-d832-4a56-8a8a-59459115b90e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:00.713223 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-72b98ba7-d832-4a56-8a8a-59459115b90e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:00.823245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d89c3952-9dd9-4f66-944a-4811cf1f37c2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:00.831053 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d89c3952-9dd9-4f66-944a-4811cf1f37c2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.218373 Oct 27 17:31:00.832153 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 39/77] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:00 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:00.836931 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9e1438fa-efa0-41e4-b4ae-86dacdd0fcbe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:00.837751 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9e1438fa-efa0-41e4-b4ae-86dacdd0fcbe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:00.844093 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e1438fa-efa0-41e4-b4ae-86dacdd0fcbe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:00.844805 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e1438fa-efa0-41e4-b4ae-86dacdd0fcbe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:00.845434 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e1438fa-efa0-41e4-b4ae-86dacdd0fcbe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:00.846355 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e1438fa-efa0-41e4-b4ae-86dacdd0fcbe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:00.847014 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e1438fa-efa0-41e4-b4ae-86dacdd0fcbe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:00.848154 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e1438fa-efa0-41e4-b4ae-86dacdd0fcbe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:00.884197 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-72b98ba7-d832-4a56-8a8a-59459115b90e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:00.896002 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-72b98ba7-d832-4a56-8a8a-59459115b90e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.199275 Oct 27 17:31:00.897705 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 39/78] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:00 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:01.017365 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9e1438fa-efa0-41e4-b4ae-86dacdd0fcbe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:01.026111 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9e1438fa-efa0-41e4-b4ae-86dacdd0fcbe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.192764 Oct 27 17:31:01.026687 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 40/79] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:00 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:01.101708 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-ff67e6ef-c1ff-4c95-8540-a9f92db72d55 req-13becfbc-631b-4025-a88f-4e0dcf0419d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13686e3e-dfd4-4f2e-9781-92321ff85702", "tag": "021b0623-ac50-4080-925e-8bf3d47884b1"}, {"name": "network-changed", "server_uuid": "2b27a822-4c22-45f0-872b-67e5f360f45e", "tag": "8d525473-0013-4431-baf7-e343fbc1a2eb"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:31:01.115302 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-ff67e6ef-c1ff-4c95-8540-a9f92db72d55 req-13becfbc-631b-4025-a88f-4e0dcf0419d2 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:01.115930 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-ff67e6ef-c1ff-4c95-8540-a9f92db72d55 req-13becfbc-631b-4025-a88f-4e0dcf0419d2 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:01.116472 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-ff67e6ef-c1ff-4c95-8540-a9f92db72d55 req-13becfbc-631b-4025-a88f-4e0dcf0419d2 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:01.130201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-ff67e6ef-c1ff-4c95-8540-a9f92db72d55 req-13becfbc-631b-4025-a88f-4e0dcf0419d2 service nova] Creating event network-changed:021b0623-ac50-4080-925e-8bf3d47884b1 for instance 13686e3e-dfd4-4f2e-9781-92321ff85702 on hv-cinder-86283 Oct 27 17:31:01.130950 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-ff67e6ef-c1ff-4c95-8540-a9f92db72d55 req-13becfbc-631b-4025-a88f-4e0dcf0419d2 service nova] Creating event network-changed:8d525473-0013-4431-baf7-e343fbc1a2eb for instance 2b27a822-4c22-45f0-872b-67e5f360f45e on hv-cinder-86283 Oct 27 17:31:01.137528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-ff67e6ef-c1ff-4c95-8540-a9f92db72d55 req-13becfbc-631b-4025-a88f-4e0dcf0419d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039854 Oct 27 17:31:01.138335 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 40/80] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:31:01.224809 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-27f0a682-3426-43c6-b363-82f2a4da0b9a req-3e32255e-3f9c-43fe-9a2b-a11ea9034f0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c65005a-985e-4fae-a09d-8cfc17bc9e93", "tag": "ed86609d-1807-41a9-9302-15671bc13ea6"}, {"name": "network-changed", "server_uuid": "8a9f11af-ebc7-4b43-80e4-e03e24ae3490", "tag": "689c3b28-8322-4e68-94df-67c69ac85d72"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:31:01.239428 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-27f0a682-3426-43c6-b363-82f2a4da0b9a req-3e32255e-3f9c-43fe-9a2b-a11ea9034f0c service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:01.240168 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-27f0a682-3426-43c6-b363-82f2a4da0b9a req-3e32255e-3f9c-43fe-9a2b-a11ea9034f0c service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:01.240773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-27f0a682-3426-43c6-b363-82f2a4da0b9a req-3e32255e-3f9c-43fe-9a2b-a11ea9034f0c service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:01.242204 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-eab85f3f-20a9-4b78-84b8-45a605018605 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:01.243069 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-eab85f3f-20a9-4b78-84b8-45a605018605 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:01.250492 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eab85f3f-20a9-4b78-84b8-45a605018605 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:01.251057 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eab85f3f-20a9-4b78-84b8-45a605018605 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:01.251589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eab85f3f-20a9-4b78-84b8-45a605018605 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:01.252406 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eab85f3f-20a9-4b78-84b8-45a605018605 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:01.252935 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eab85f3f-20a9-4b78-84b8-45a605018605 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:01.253437 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eab85f3f-20a9-4b78-84b8-45a605018605 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:01.270007 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-27f0a682-3426-43c6-b363-82f2a4da0b9a req-3e32255e-3f9c-43fe-9a2b-a11ea9034f0c service nova] Creating event network-changed:ed86609d-1807-41a9-9302-15671bc13ea6 for instance 3c65005a-985e-4fae-a09d-8cfc17bc9e93 on hv-cinder-86283 Oct 27 17:31:01.270514 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-27f0a682-3426-43c6-b363-82f2a4da0b9a req-3e32255e-3f9c-43fe-9a2b-a11ea9034f0c service nova] Creating event network-changed:689c3b28-8322-4e68-94df-67c69ac85d72 for instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 on hv-cinder-86283 Oct 27 17:31:01.271044 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-27f0a682-3426-43c6-b363-82f2a4da0b9a req-3e32255e-3f9c-43fe-9a2b-a11ea9034f0c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119046) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 17:31:01.271422 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-27f0a682-3426-43c6-b363-82f2a4da0b9a req-3e32255e-3f9c-43fe-9a2b-a11ea9034f0c service nova] Acquired lock "compute-rpcapi-router" {{(pid=119046) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 17:31:01.272463 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7281adae-34d8-4639-9d4d-f404b566225d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:01.273014 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7281adae-34d8-4639-9d4d-f404b566225d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:01.273409 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7281adae-34d8-4639-9d4d-f404b566225d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:01.274013 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7281adae-34d8-4639-9d4d-f404b566225d None None] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:01.274453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7281adae-34d8-4639-9d4d-f404b566225d None None] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:01.274910 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7281adae-34d8-4639-9d4d-f404b566225d None None] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:01.286541 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.compute.rpcapi [None req-7281adae-34d8-4639-9d4d-f404b566225d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 27 17:31:01.287437 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7281adae-34d8-4639-9d4d-f404b566225d None None] Releasing lock "compute-rpcapi-router" {{(pid=119046) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 17:31:01.313013 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7281adae-34d8-4639-9d4d-f404b566225d None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.092056 Oct 27 17:31:01.314026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 41/81] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:31:01.442124 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-eab85f3f-20a9-4b78-84b8-45a605018605 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:01.453505 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-eab85f3f-20a9-4b78-84b8-45a605018605 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.219161 Oct 27 17:31:01.454073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 41/82] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:01 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:01.474192 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-1c8438bd-864c-4267-a114-75359e1d6e07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:01.474905 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-1c8438bd-864c-4267-a114-75359e1d6e07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:01.481331 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1c8438bd-864c-4267-a114-75359e1d6e07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:01.481834 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1c8438bd-864c-4267-a114-75359e1d6e07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:01.482501 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1c8438bd-864c-4267-a114-75359e1d6e07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:01.483198 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1c8438bd-864c-4267-a114-75359e1d6e07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:01.483655 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1c8438bd-864c-4267-a114-75359e1d6e07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:01.484106 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1c8438bd-864c-4267-a114-75359e1d6e07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:01.705809 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1c8438bd-864c-4267-a114-75359e1d6e07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:01.716617 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1c8438bd-864c-4267-a114-75359e1d6e07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:01.720912 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1c8438bd-864c-4267-a114-75359e1d6e07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:01.722391 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-1c8438bd-864c-4267-a114-75359e1d6e07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.253387 Oct 27 17:31:01.729437 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 42/83] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:01 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:01.856505 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-9f8f8972-4a28-4b80-8122-391065efd631 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:01.858083 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-9f8f8972-4a28-4b80-8122-391065efd631 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:01.865206 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f8f8972-4a28-4b80-8122-391065efd631 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:01.866364 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f8f8972-4a28-4b80-8122-391065efd631 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:01.866986 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f8f8972-4a28-4b80-8122-391065efd631 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:01.868330 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f8f8972-4a28-4b80-8122-391065efd631 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:01.869261 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f8f8972-4a28-4b80-8122-391065efd631 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:01.869877 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f8f8972-4a28-4b80-8122-391065efd631 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:01.920219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-08cff2f4-04ea-48d0-9afd-d14c074bb8db tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:01.920841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-08cff2f4-04ea-48d0-9afd-d14c074bb8db tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:01.929647 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-08cff2f4-04ea-48d0-9afd-d14c074bb8db tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:01.931757 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-08cff2f4-04ea-48d0-9afd-d14c074bb8db tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:01.932531 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-08cff2f4-04ea-48d0-9afd-d14c074bb8db tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:01.933518 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-08cff2f4-04ea-48d0-9afd-d14c074bb8db tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:01.940014 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-08cff2f4-04ea-48d0-9afd-d14c074bb8db tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:01.940691 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-08cff2f4-04ea-48d0-9afd-d14c074bb8db tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:02.068847 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9f8f8972-4a28-4b80-8122-391065efd631 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:02.077449 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-9f8f8972-4a28-4b80-8122-391065efd631 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.224648 Oct 27 17:31:02.080256 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 42/84] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:01 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:02.087441 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f0a8ed39-1ad3-488a-95e0-d111fabf25ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:02.088089 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f0a8ed39-1ad3-488a-95e0-d111fabf25ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:02.104615 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f0a8ed39-1ad3-488a-95e0-d111fabf25ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:02.105539 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f0a8ed39-1ad3-488a-95e0-d111fabf25ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:02.110387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f0a8ed39-1ad3-488a-95e0-d111fabf25ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:02.111133 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f0a8ed39-1ad3-488a-95e0-d111fabf25ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:02.111595 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f0a8ed39-1ad3-488a-95e0-d111fabf25ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:02.112064 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f0a8ed39-1ad3-488a-95e0-d111fabf25ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:02.180879 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-08cff2f4-04ea-48d0-9afd-d14c074bb8db tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:02.189463 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-08cff2f4-04ea-48d0-9afd-d14c074bb8db tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.273289 Oct 27 17:31:02.190692 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 43/85] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:01 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:02.281337 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f0a8ed39-1ad3-488a-95e0-d111fabf25ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:02.289592 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f0a8ed39-1ad3-488a-95e0-d111fabf25ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.206000 Oct 27 17:31:02.290172 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 43/86] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:02 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:02.478026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d5e2d95d-19a4-4cf5-aac5-9209f3a64671 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:02.478664 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d5e2d95d-19a4-4cf5-aac5-9209f3a64671 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:02.487969 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5e2d95d-19a4-4cf5-aac5-9209f3a64671 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:02.488855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5e2d95d-19a4-4cf5-aac5-9209f3a64671 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:02.489441 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5e2d95d-19a4-4cf5-aac5-9209f3a64671 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:02.490489 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5e2d95d-19a4-4cf5-aac5-9209f3a64671 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:02.491117 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5e2d95d-19a4-4cf5-aac5-9209f3a64671 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:02.492008 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5e2d95d-19a4-4cf5-aac5-9209f3a64671 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:02.644328 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d5e2d95d-19a4-4cf5-aac5-9209f3a64671 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:02.652044 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d5e2d95d-19a4-4cf5-aac5-9209f3a64671 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.177777 Oct 27 17:31:02.652566 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 44/87] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:02 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:02.753417 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d6baa5ea-e010-47f4-a6a9-36ef3f558827 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:02.754308 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d6baa5ea-e010-47f4-a6a9-36ef3f558827 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:02.760473 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d6baa5ea-e010-47f4-a6a9-36ef3f558827 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:02.761156 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d6baa5ea-e010-47f4-a6a9-36ef3f558827 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:02.761686 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d6baa5ea-e010-47f4-a6a9-36ef3f558827 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:02.762441 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d6baa5ea-e010-47f4-a6a9-36ef3f558827 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:02.762968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d6baa5ea-e010-47f4-a6a9-36ef3f558827 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:02.763472 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d6baa5ea-e010-47f4-a6a9-36ef3f558827 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:02.893754 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d6baa5ea-e010-47f4-a6a9-36ef3f558827 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:02.902927 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d6baa5ea-e010-47f4-a6a9-36ef3f558827 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:02.904412 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d6baa5ea-e010-47f4-a6a9-36ef3f558827 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:02.905519 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d6baa5ea-e010-47f4-a6a9-36ef3f558827 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.156552 Oct 27 17:31:02.906079 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 44/88] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:02 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:03.102381 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8ced38ad-ad83-4476-ab6c-bf22c8f5304a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:03.103020 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8ced38ad-ad83-4476-ab6c-bf22c8f5304a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:03.109168 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ced38ad-ad83-4476-ab6c-bf22c8f5304a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:03.109652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ced38ad-ad83-4476-ab6c-bf22c8f5304a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:03.110081 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ced38ad-ad83-4476-ab6c-bf22c8f5304a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:03.110764 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ced38ad-ad83-4476-ab6c-bf22c8f5304a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:03.111216 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ced38ad-ad83-4476-ab6c-bf22c8f5304a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:03.111637 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ced38ad-ad83-4476-ab6c-bf22c8f5304a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:03.212657 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-492c7f08-c77d-4236-8541-80f3e64c9761 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:03.213281 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-492c7f08-c77d-4236-8541-80f3e64c9761 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:03.219285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-492c7f08-c77d-4236-8541-80f3e64c9761 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:03.219795 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-492c7f08-c77d-4236-8541-80f3e64c9761 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:03.220230 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-492c7f08-c77d-4236-8541-80f3e64c9761 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:03.220940 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-492c7f08-c77d-4236-8541-80f3e64c9761 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:03.221391 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-492c7f08-c77d-4236-8541-80f3e64c9761 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:03.221812 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-492c7f08-c77d-4236-8541-80f3e64c9761 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:03.242044 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8ced38ad-ad83-4476-ab6c-bf22c8f5304a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:03.249589 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8ced38ad-ad83-4476-ab6c-bf22c8f5304a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.151055 Oct 27 17:31:03.250166 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 45/89] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:03 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:03.312705 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-89d20ca2-816e-460f-acf1-9b9df9112d64 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:03.313369 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-89d20ca2-816e-460f-acf1-9b9df9112d64 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:03.320143 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-89d20ca2-816e-460f-acf1-9b9df9112d64 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:03.320626 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-89d20ca2-816e-460f-acf1-9b9df9112d64 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:03.321060 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-89d20ca2-816e-460f-acf1-9b9df9112d64 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:03.321774 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-89d20ca2-816e-460f-acf1-9b9df9112d64 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:03.322227 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-89d20ca2-816e-460f-acf1-9b9df9112d64 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:03.322648 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-89d20ca2-816e-460f-acf1-9b9df9112d64 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:03.360585 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-492c7f08-c77d-4236-8541-80f3e64c9761 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:03.368450 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-492c7f08-c77d-4236-8541-80f3e64c9761 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.159857 Oct 27 17:31:03.369033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 45/90] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:03 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:03.450239 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-89d20ca2-816e-460f-acf1-9b9df9112d64 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:03.457828 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-89d20ca2-816e-460f-acf1-9b9df9112d64 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.149714 Oct 27 17:31:03.458399 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 46/91] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:03 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:03.677228 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c4000492-d122-4c93-a7fb-2d03a3912beb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:03.677847 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c4000492-d122-4c93-a7fb-2d03a3912beb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:03.683980 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c4000492-d122-4c93-a7fb-2d03a3912beb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:03.684464 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c4000492-d122-4c93-a7fb-2d03a3912beb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:03.684895 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c4000492-d122-4c93-a7fb-2d03a3912beb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:03.685581 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c4000492-d122-4c93-a7fb-2d03a3912beb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:03.686032 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c4000492-d122-4c93-a7fb-2d03a3912beb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:03.686452 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c4000492-d122-4c93-a7fb-2d03a3912beb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:03.831231 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c4000492-d122-4c93-a7fb-2d03a3912beb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:03.839371 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c4000492-d122-4c93-a7fb-2d03a3912beb tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.166860 Oct 27 17:31:03.839971 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 46/92] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:03 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:03.934289 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-cab26d63-2a91-4ac5-af59-36560e58d372 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:03.935547 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-cab26d63-2a91-4ac5-af59-36560e58d372 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:03.941737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cab26d63-2a91-4ac5-af59-36560e58d372 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:03.942220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cab26d63-2a91-4ac5-af59-36560e58d372 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:03.942672 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cab26d63-2a91-4ac5-af59-36560e58d372 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:03.943365 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cab26d63-2a91-4ac5-af59-36560e58d372 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:03.943842 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cab26d63-2a91-4ac5-af59-36560e58d372 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:03.944266 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cab26d63-2a91-4ac5-af59-36560e58d372 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:04.111790 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-cab26d63-2a91-4ac5-af59-36560e58d372 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:04.122365 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-cab26d63-2a91-4ac5-af59-36560e58d372 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:04.123992 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-cab26d63-2a91-4ac5-af59-36560e58d372 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:04.125107 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-cab26d63-2a91-4ac5-af59-36560e58d372 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.195071 Oct 27 17:31:04.125662 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 47/93] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:03 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:04.272374 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-35bd1a55-167e-4585-82b6-313f3058d6b2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:04.274842 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-35bd1a55-167e-4585-82b6-313f3058d6b2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:04.281230 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-35bd1a55-167e-4585-82b6-313f3058d6b2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:04.281711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-35bd1a55-167e-4585-82b6-313f3058d6b2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:04.282246 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-35bd1a55-167e-4585-82b6-313f3058d6b2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:04.282935 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-35bd1a55-167e-4585-82b6-313f3058d6b2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:04.283415 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-35bd1a55-167e-4585-82b6-313f3058d6b2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:04.283982 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-35bd1a55-167e-4585-82b6-313f3058d6b2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:04.394362 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-012b371b-2417-49c3-994c-3ee70cdbb624 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:04.400730 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-012b371b-2417-49c3-994c-3ee70cdbb624 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:04.415674 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-012b371b-2417-49c3-994c-3ee70cdbb624 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:04.427331 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-012b371b-2417-49c3-994c-3ee70cdbb624 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:04.434963 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-012b371b-2417-49c3-994c-3ee70cdbb624 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:04.436089 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-012b371b-2417-49c3-994c-3ee70cdbb624 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:04.436840 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-012b371b-2417-49c3-994c-3ee70cdbb624 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:04.438049 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-012b371b-2417-49c3-994c-3ee70cdbb624 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:05.021432 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-35bd1a55-167e-4585-82b6-313f3058d6b2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:05.032546 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-35bd1a55-167e-4585-82b6-313f3058d6b2 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.763993 Oct 27 17:31:05.059189 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 47/94] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:04 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:05.059189 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ae82bd1d-8491-40b9-824e-ec43e852ac88 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:05.059189 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-ae82bd1d-8491-40b9-824e-ec43e852ac88 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:05.063298 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ae82bd1d-8491-40b9-824e-ec43e852ac88 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:05.063828 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ae82bd1d-8491-40b9-824e-ec43e852ac88 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:05.064306 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ae82bd1d-8491-40b9-824e-ec43e852ac88 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:05.065061 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ae82bd1d-8491-40b9-824e-ec43e852ac88 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:05.065554 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ae82bd1d-8491-40b9-824e-ec43e852ac88 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:05.065997 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ae82bd1d-8491-40b9-824e-ec43e852ac88 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:05.226431 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-012b371b-2417-49c3-994c-3ee70cdbb624 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:05.241157 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-012b371b-2417-49c3-994c-3ee70cdbb624 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.852539 Oct 27 17:31:05.241761 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 48/95] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:04 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:05.246472 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-985f64e3-5013-43d0-bb62-89f978aad8a6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:05.247286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-985f64e3-5013-43d0-bb62-89f978aad8a6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:05.254166 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-985f64e3-5013-43d0-bb62-89f978aad8a6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:05.254875 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-985f64e3-5013-43d0-bb62-89f978aad8a6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:05.255527 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-985f64e3-5013-43d0-bb62-89f978aad8a6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:05.256516 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-985f64e3-5013-43d0-bb62-89f978aad8a6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:05.257182 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-985f64e3-5013-43d0-bb62-89f978aad8a6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:05.257832 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-985f64e3-5013-43d0-bb62-89f978aad8a6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:05.506518 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ae82bd1d-8491-40b9-824e-ec43e852ac88 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:05.521867 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-ae82bd1d-8491-40b9-824e-ec43e852ac88 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.475857 Oct 27 17:31:05.523495 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 48/96] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:05 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:05.532547 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c0d590bd-f233-4ecb-a1b2-f4907a2e1e4e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:05.533459 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c0d590bd-f233-4ecb-a1b2-f4907a2e1e4e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:05.542077 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c0d590bd-f233-4ecb-a1b2-f4907a2e1e4e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:05.543055 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c0d590bd-f233-4ecb-a1b2-f4907a2e1e4e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:05.544411 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c0d590bd-f233-4ecb-a1b2-f4907a2e1e4e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:05.545364 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c0d590bd-f233-4ecb-a1b2-f4907a2e1e4e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:05.546039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c0d590bd-f233-4ecb-a1b2-f4907a2e1e4e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:05.546723 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c0d590bd-f233-4ecb-a1b2-f4907a2e1e4e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:05.751062 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-985f64e3-5013-43d0-bb62-89f978aad8a6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:05.760741 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-985f64e3-5013-43d0-bb62-89f978aad8a6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.517653 Oct 27 17:31:05.768256 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 49/97] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:05 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:05.820342 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c0d590bd-f233-4ecb-a1b2-f4907a2e1e4e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:05.829625 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c0d590bd-f233-4ecb-a1b2-f4907a2e1e4e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:05.831240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c0d590bd-f233-4ecb-a1b2-f4907a2e1e4e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:05.832722 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c0d590bd-f233-4ecb-a1b2-f4907a2e1e4e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.307741 Oct 27 17:31:05.833030 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 49/98] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:05 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:06.069363 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-bbc02a68-76e1-4191-9d04-b1adacdd702d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:06.069974 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-bbc02a68-76e1-4191-9d04-b1adacdd702d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:06.076739 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bbc02a68-76e1-4191-9d04-b1adacdd702d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:06.076739 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bbc02a68-76e1-4191-9d04-b1adacdd702d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:06.077173 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bbc02a68-76e1-4191-9d04-b1adacdd702d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:06.077866 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bbc02a68-76e1-4191-9d04-b1adacdd702d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:06.078323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bbc02a68-76e1-4191-9d04-b1adacdd702d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:06.078750 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bbc02a68-76e1-4191-9d04-b1adacdd702d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:06.231117 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-bbc02a68-76e1-4191-9d04-b1adacdd702d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:06.240225 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-bbc02a68-76e1-4191-9d04-b1adacdd702d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.175251 Oct 27 17:31:06.241579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 50/99] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:06 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:06.265373 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5a12b207-8720-40bf-b152-bc3debf83a93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:06.266071 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-5a12b207-8720-40bf-b152-bc3debf83a93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:06.271994 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5a12b207-8720-40bf-b152-bc3debf83a93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:06.272485 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5a12b207-8720-40bf-b152-bc3debf83a93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:06.272921 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5a12b207-8720-40bf-b152-bc3debf83a93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:06.273599 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5a12b207-8720-40bf-b152-bc3debf83a93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:06.274052 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5a12b207-8720-40bf-b152-bc3debf83a93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:06.274477 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5a12b207-8720-40bf-b152-bc3debf83a93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:06.421907 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-5a12b207-8720-40bf-b152-bc3debf83a93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:06.443436 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5a12b207-8720-40bf-b152-bc3debf83a93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.181581 Oct 27 17:31:06.444566 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 50/100] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:06 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:06.545909 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3ce5e348-3a10-4766-a2dc-b7a6dd3a3f44 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:06.546534 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-3ce5e348-3a10-4766-a2dc-b7a6dd3a3f44 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:06.552563 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3ce5e348-3a10-4766-a2dc-b7a6dd3a3f44 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:06.553038 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3ce5e348-3a10-4766-a2dc-b7a6dd3a3f44 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:06.553467 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3ce5e348-3a10-4766-a2dc-b7a6dd3a3f44 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:06.554182 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3ce5e348-3a10-4766-a2dc-b7a6dd3a3f44 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:06.554813 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3ce5e348-3a10-4766-a2dc-b7a6dd3a3f44 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:06.555238 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3ce5e348-3a10-4766-a2dc-b7a6dd3a3f44 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:06.716038 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-3ce5e348-3a10-4766-a2dc-b7a6dd3a3f44 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:06.724840 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-3ce5e348-3a10-4766-a2dc-b7a6dd3a3f44 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.182767 Oct 27 17:31:06.725629 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 51/101] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:06 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:06.788695 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-04e6fd88-3448-4fdf-967f-77ac4d7109a5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:06.789201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-04e6fd88-3448-4fdf-967f-77ac4d7109a5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:06.796223 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04e6fd88-3448-4fdf-967f-77ac4d7109a5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:06.796906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04e6fd88-3448-4fdf-967f-77ac4d7109a5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:06.797342 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04e6fd88-3448-4fdf-967f-77ac4d7109a5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:06.798073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04e6fd88-3448-4fdf-967f-77ac4d7109a5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:06.798527 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04e6fd88-3448-4fdf-967f-77ac4d7109a5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:06.798952 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04e6fd88-3448-4fdf-967f-77ac4d7109a5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:06.858019 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-80849134-2671-4168-9d9b-c5fbde95d48a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:06.858631 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-80849134-2671-4168-9d9b-c5fbde95d48a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:06.865968 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-80849134-2671-4168-9d9b-c5fbde95d48a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:06.866403 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-80849134-2671-4168-9d9b-c5fbde95d48a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:06.866818 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-80849134-2671-4168-9d9b-c5fbde95d48a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:06.867507 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-80849134-2671-4168-9d9b-c5fbde95d48a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:06.867984 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-80849134-2671-4168-9d9b-c5fbde95d48a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:06.868441 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-80849134-2671-4168-9d9b-c5fbde95d48a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:07.008301 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-04e6fd88-3448-4fdf-967f-77ac4d7109a5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:07.019680 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-80849134-2671-4168-9d9b-c5fbde95d48a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:07.027305 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-04e6fd88-3448-4fdf-967f-77ac4d7109a5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.242471 Oct 27 17:31:07.027305 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 51/102] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:06 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:07.034436 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-80849134-2671-4168-9d9b-c5fbde95d48a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:07.037188 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-80849134-2671-4168-9d9b-c5fbde95d48a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:07.038762 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-80849134-2671-4168-9d9b-c5fbde95d48a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.185077 Oct 27 17:31:07.039947 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 52/103] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:06 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:31:07.265583 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-7f474a61-5e83-4eb4-82e5-d1c6963742fc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:07.266402 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-7f474a61-5e83-4eb4-82e5-d1c6963742fc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:07.273105 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f474a61-5e83-4eb4-82e5-d1c6963742fc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:07.273580 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f474a61-5e83-4eb4-82e5-d1c6963742fc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:07.274003 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f474a61-5e83-4eb4-82e5-d1c6963742fc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:07.274814 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f474a61-5e83-4eb4-82e5-d1c6963742fc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:07.275261 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f474a61-5e83-4eb4-82e5-d1c6963742fc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:07.275750 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f474a61-5e83-4eb4-82e5-d1c6963742fc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:07.457073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7f474a61-5e83-4eb4-82e5-d1c6963742fc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:07.466221 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-7f474a61-5e83-4eb4-82e5-d1c6963742fc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.205246 Oct 27 17:31:07.466845 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 52/104] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:07 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:07.469094 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-83c218aa-3820-48a9-a242-0d7a6e8b1e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:07.469715 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-83c218aa-3820-48a9-a242-0d7a6e8b1e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:07.476570 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83c218aa-3820-48a9-a242-0d7a6e8b1e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:07.477050 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83c218aa-3820-48a9-a242-0d7a6e8b1e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:07.477484 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83c218aa-3820-48a9-a242-0d7a6e8b1e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:07.478172 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83c218aa-3820-48a9-a242-0d7a6e8b1e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:07.478617 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83c218aa-3820-48a9-a242-0d7a6e8b1e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:07.479233 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83c218aa-3820-48a9-a242-0d7a6e8b1e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:07.502512 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=100 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:31:07.680721 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-83c218aa-3820-48a9-a242-0d7a6e8b1e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:07.690185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-83c218aa-3820-48a9-a242-0d7a6e8b1e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.225415 Oct 27 17:31:07.691820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 53/105] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:07 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:07.750316 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-9d500b69-b28e-46f3-aa30-280a2896c329 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:07.750993 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-9d500b69-b28e-46f3-aa30-280a2896c329 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:07.759200 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9d500b69-b28e-46f3-aa30-280a2896c329 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:07.759703 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9d500b69-b28e-46f3-aa30-280a2896c329 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:07.760185 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9d500b69-b28e-46f3-aa30-280a2896c329 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:07.760910 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9d500b69-b28e-46f3-aa30-280a2896c329 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:07.761367 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9d500b69-b28e-46f3-aa30-280a2896c329 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:07.762793 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9d500b69-b28e-46f3-aa30-280a2896c329 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:07.915766 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9d500b69-b28e-46f3-aa30-280a2896c329 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:07.924428 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-9d500b69-b28e-46f3-aa30-280a2896c329 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.178998 Oct 27 17:31:07.925588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 53/106] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:07 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:08.051481 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b6a7d155-7dae-4cd0-a269-bdfa65a1122f tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:08.052507 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b6a7d155-7dae-4cd0-a269-bdfa65a1122f tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:08.058984 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6a7d155-7dae-4cd0-a269-bdfa65a1122f tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:08.059774 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6a7d155-7dae-4cd0-a269-bdfa65a1122f tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:08.060415 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6a7d155-7dae-4cd0-a269-bdfa65a1122f tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:08.061345 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6a7d155-7dae-4cd0-a269-bdfa65a1122f tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:08.061997 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6a7d155-7dae-4cd0-a269-bdfa65a1122f tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:08.062618 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6a7d155-7dae-4cd0-a269-bdfa65a1122f tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:08.071327 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c6d80026-0c2c-4deb-ad45-4a99a019a7ee tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:08.074527 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c6d80026-0c2c-4deb-ad45-4a99a019a7ee tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:08.094658 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c6d80026-0c2c-4deb-ad45-4a99a019a7ee tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:08.095556 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c6d80026-0c2c-4deb-ad45-4a99a019a7ee tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:08.096288 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c6d80026-0c2c-4deb-ad45-4a99a019a7ee tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:08.097220 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c6d80026-0c2c-4deb-ad45-4a99a019a7ee tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:08.097794 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c6d80026-0c2c-4deb-ad45-4a99a019a7ee tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:08.098331 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c6d80026-0c2c-4deb-ad45-4a99a019a7ee tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:08.278810 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b6a7d155-7dae-4cd0-a269-bdfa65a1122f tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:08.283328 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c6d80026-0c2c-4deb-ad45-4a99a019a7ee tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:08.287490 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=100 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:31:08.290350 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b6a7d155-7dae-4cd0-a269-bdfa65a1122f tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.242017 Oct 27 17:31:08.299357 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 54/107] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:08 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:08.301283 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c6d80026-0c2c-4deb-ad45-4a99a019a7ee tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:08.302861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c6d80026-0c2c-4deb-ad45-4a99a019a7ee tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:08.304808 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c6d80026-0c2c-4deb-ad45-4a99a019a7ee tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.243551 Oct 27 17:31:08.305957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 54/108] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:08 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:08.493886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-43dc95c2-dfa8-44ae-9fea-93b412a9081b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:08.494620 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-43dc95c2-dfa8-44ae-9fea-93b412a9081b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:08.502091 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43dc95c2-dfa8-44ae-9fea-93b412a9081b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:08.502885 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43dc95c2-dfa8-44ae-9fea-93b412a9081b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:08.504162 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43dc95c2-dfa8-44ae-9fea-93b412a9081b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:08.504880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43dc95c2-dfa8-44ae-9fea-93b412a9081b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:08.505332 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43dc95c2-dfa8-44ae-9fea-93b412a9081b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:08.505746 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43dc95c2-dfa8-44ae-9fea-93b412a9081b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:08.654245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-43dc95c2-dfa8-44ae-9fea-93b412a9081b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:08.662688 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-43dc95c2-dfa8-44ae-9fea-93b412a9081b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.173751 Oct 27 17:31:08.663242 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 55/109] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:08 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:08.714346 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-96719c77-4336-4d17-a6a3-e9df55345a1c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:08.714958 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-96719c77-4336-4d17-a6a3-e9df55345a1c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:08.721125 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-96719c77-4336-4d17-a6a3-e9df55345a1c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:08.721607 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-96719c77-4336-4d17-a6a3-e9df55345a1c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:08.723230 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-96719c77-4336-4d17-a6a3-e9df55345a1c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:08.723976 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-96719c77-4336-4d17-a6a3-e9df55345a1c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:08.724428 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-96719c77-4336-4d17-a6a3-e9df55345a1c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:08.724849 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-96719c77-4336-4d17-a6a3-e9df55345a1c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:08.860471 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-96719c77-4336-4d17-a6a3-e9df55345a1c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:08.869602 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-96719c77-4336-4d17-a6a3-e9df55345a1c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.159706 Oct 27 17:31:08.878235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 55/110] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:08 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:08.949698 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2a71154a-dfe9-4959-ad54-fb9049ccb0d7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:08.950303 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2a71154a-dfe9-4959-ad54-fb9049ccb0d7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:08.956000 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2a71154a-dfe9-4959-ad54-fb9049ccb0d7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:08.956507 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2a71154a-dfe9-4959-ad54-fb9049ccb0d7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:08.956932 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2a71154a-dfe9-4959-ad54-fb9049ccb0d7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:08.957610 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2a71154a-dfe9-4959-ad54-fb9049ccb0d7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:08.958093 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2a71154a-dfe9-4959-ad54-fb9049ccb0d7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:08.958510 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2a71154a-dfe9-4959-ad54-fb9049ccb0d7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:09.104491 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2a71154a-dfe9-4959-ad54-fb9049ccb0d7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:09.113700 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2a71154a-dfe9-4959-ad54-fb9049ccb0d7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.168423 Oct 27 17:31:09.114479 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 56/111] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:08 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:09.312666 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-29447aac-c1a5-42e1-87b0-27946ab2ed05 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:09.337997 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d422de8f-3b40-4dcf-86c0-1f81eb675c87 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:09.338631 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d422de8f-3b40-4dcf-86c0-1f81eb675c87 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:09.339127 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-29447aac-c1a5-42e1-87b0-27946ab2ed05 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:09.350761 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d422de8f-3b40-4dcf-86c0-1f81eb675c87 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:09.352128 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:31:09.353695 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29447aac-c1a5-42e1-87b0-27946ab2ed05 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:09.354581 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d422de8f-3b40-4dcf-86c0-1f81eb675c87 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:09.355032 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d422de8f-3b40-4dcf-86c0-1f81eb675c87 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:09.355911 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d422de8f-3b40-4dcf-86c0-1f81eb675c87 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:09.356403 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d422de8f-3b40-4dcf-86c0-1f81eb675c87 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:09.356762 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d422de8f-3b40-4dcf-86c0-1f81eb675c87 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:09.361480 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29447aac-c1a5-42e1-87b0-27946ab2ed05 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:09.362008 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29447aac-c1a5-42e1-87b0-27946ab2ed05 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:09.362836 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29447aac-c1a5-42e1-87b0-27946ab2ed05 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:09.363304 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29447aac-c1a5-42e1-87b0-27946ab2ed05 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:09.363797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29447aac-c1a5-42e1-87b0-27946ab2ed05 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:09.512898 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-29447aac-c1a5-42e1-87b0-27946ab2ed05 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:09.522485 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-29447aac-c1a5-42e1-87b0-27946ab2ed05 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.213581 Oct 27 17:31:09.523093 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 56/112] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:09 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:09.545762 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d422de8f-3b40-4dcf-86c0-1f81eb675c87 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:09.554539 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d422de8f-3b40-4dcf-86c0-1f81eb675c87 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:09.556833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d422de8f-3b40-4dcf-86c0-1f81eb675c87 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:09.558131 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d422de8f-3b40-4dcf-86c0-1f81eb675c87 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.226770 Oct 27 17:31:09.559255 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 57/113] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:09 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:09.687976 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2ef65c01-4d1d-4d2e-bbc4-0a1fa57d5c8b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:09.689117 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2ef65c01-4d1d-4d2e-bbc4-0a1fa57d5c8b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:09.696480 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ef65c01-4d1d-4d2e-bbc4-0a1fa57d5c8b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:09.697742 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ef65c01-4d1d-4d2e-bbc4-0a1fa57d5c8b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:09.698751 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ef65c01-4d1d-4d2e-bbc4-0a1fa57d5c8b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:09.699609 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ef65c01-4d1d-4d2e-bbc4-0a1fa57d5c8b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:09.700229 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ef65c01-4d1d-4d2e-bbc4-0a1fa57d5c8b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:09.700822 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ef65c01-4d1d-4d2e-bbc4-0a1fa57d5c8b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:09.851599 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2ef65c01-4d1d-4d2e-bbc4-0a1fa57d5c8b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:09.861812 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2ef65c01-4d1d-4d2e-bbc4-0a1fa57d5c8b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.179296 Oct 27 17:31:09.862517 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 57/114] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:09 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:09.893563 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ff61a3cd-098a-44b2-8d56-d726ab41db31 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:09.894410 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ff61a3cd-098a-44b2-8d56-d726ab41db31 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:09.907910 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ff61a3cd-098a-44b2-8d56-d726ab41db31 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:09.907910 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ff61a3cd-098a-44b2-8d56-d726ab41db31 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:09.907910 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ff61a3cd-098a-44b2-8d56-d726ab41db31 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:09.907910 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ff61a3cd-098a-44b2-8d56-d726ab41db31 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:09.908258 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ff61a3cd-098a-44b2-8d56-d726ab41db31 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:09.908258 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ff61a3cd-098a-44b2-8d56-d726ab41db31 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:10.043157 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ff61a3cd-098a-44b2-8d56-d726ab41db31 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:10.051144 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ff61a3cd-098a-44b2-8d56-d726ab41db31 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.162000 Oct 27 17:31:10.052733 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 58/115] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:09 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:10.137624 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-eb6c4a56-a9cf-4f39-8c6c-107adb9e185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:10.138243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-eb6c4a56-a9cf-4f39-8c6c-107adb9e185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:10.144476 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eb6c4a56-a9cf-4f39-8c6c-107adb9e185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:10.144958 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eb6c4a56-a9cf-4f39-8c6c-107adb9e185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:10.145384 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eb6c4a56-a9cf-4f39-8c6c-107adb9e185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:10.146078 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eb6c4a56-a9cf-4f39-8c6c-107adb9e185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:10.146523 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eb6c4a56-a9cf-4f39-8c6c-107adb9e185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:10.146936 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eb6c4a56-a9cf-4f39-8c6c-107adb9e185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:10.546108 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2f467c32-a53e-4f0d-bf11-ba74d333b96a tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:10.546718 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2f467c32-a53e-4f0d-bf11-ba74d333b96a tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:10.564678 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2f467c32-a53e-4f0d-bf11-ba74d333b96a tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:10.565131 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2f467c32-a53e-4f0d-bf11-ba74d333b96a tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:10.565573 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2f467c32-a53e-4f0d-bf11-ba74d333b96a tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:10.566824 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2f467c32-a53e-4f0d-bf11-ba74d333b96a tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:10.567257 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2f467c32-a53e-4f0d-bf11-ba74d333b96a tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:10.567863 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2f467c32-a53e-4f0d-bf11-ba74d333b96a tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:10.593512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-eb6c4a56-a9cf-4f39-8c6c-107adb9e185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:10.605769 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-eb6c4a56-a9cf-4f39-8c6c-107adb9e185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.472082 Oct 27 17:31:10.620775 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 58/116] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:10 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:10.629614 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-fca89a19-49fc-473e-a122-02426d6e5928 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:10.630660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-fca89a19-49fc-473e-a122-02426d6e5928 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:10.638705 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fca89a19-49fc-473e-a122-02426d6e5928 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:10.639397 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fca89a19-49fc-473e-a122-02426d6e5928 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:10.640359 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fca89a19-49fc-473e-a122-02426d6e5928 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:10.641407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fca89a19-49fc-473e-a122-02426d6e5928 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:10.642054 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fca89a19-49fc-473e-a122-02426d6e5928 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:10.643230 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fca89a19-49fc-473e-a122-02426d6e5928 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:10.796650 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fca89a19-49fc-473e-a122-02426d6e5928 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:10.807503 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fca89a19-49fc-473e-a122-02426d6e5928 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:10.809160 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fca89a19-49fc-473e-a122-02426d6e5928 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:10.811252 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-fca89a19-49fc-473e-a122-02426d6e5928 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.188945 Oct 27 17:31:10.811846 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 59/117] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:10 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:10.818538 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2f467c32-a53e-4f0d-bf11-ba74d333b96a tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:10.829784 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2f467c32-a53e-4f0d-bf11-ba74d333b96a tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.287449 Oct 27 17:31:10.830367 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 59/118] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:10 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:10.885625 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a8093fc4-9072-4fdf-ac3b-db42010797c4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:10.886248 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a8093fc4-9072-4fdf-ac3b-db42010797c4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:10.892491 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a8093fc4-9072-4fdf-ac3b-db42010797c4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:10.893204 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a8093fc4-9072-4fdf-ac3b-db42010797c4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:10.893640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a8093fc4-9072-4fdf-ac3b-db42010797c4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:10.895072 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a8093fc4-9072-4fdf-ac3b-db42010797c4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:10.895524 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a8093fc4-9072-4fdf-ac3b-db42010797c4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:10.895995 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a8093fc4-9072-4fdf-ac3b-db42010797c4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:11.076431 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-13460f08-57d5-4f73-aa2f-c884c8187cac tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:11.077336 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-13460f08-57d5-4f73-aa2f-c884c8187cac tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:11.080587 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a8093fc4-9072-4fdf-ac3b-db42010797c4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:11.086649 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-13460f08-57d5-4f73-aa2f-c884c8187cac tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:11.087517 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-13460f08-57d5-4f73-aa2f-c884c8187cac tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:11.088059 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-13460f08-57d5-4f73-aa2f-c884c8187cac tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:11.089186 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-13460f08-57d5-4f73-aa2f-c884c8187cac tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:11.089992 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-13460f08-57d5-4f73-aa2f-c884c8187cac tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:11.090861 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-13460f08-57d5-4f73-aa2f-c884c8187cac tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:11.092147 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a8093fc4-9072-4fdf-ac3b-db42010797c4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.210354 Oct 27 17:31:11.093602 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 60/119] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:10 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:11.284714 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=2 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:31:11.289597 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-13460f08-57d5-4f73-aa2f-c884c8187cac tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:11.298021 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-13460f08-57d5-4f73-aa2f-c884c8187cac tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.225910 Oct 27 17:31:11.298679 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 60/120] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:11 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:11.632267 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-315b6714-c29e-45ba-8949-4dd2eae29b38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:11.632757 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-315b6714-c29e-45ba-8949-4dd2eae29b38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:11.639478 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-315b6714-c29e-45ba-8949-4dd2eae29b38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:11.640217 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-315b6714-c29e-45ba-8949-4dd2eae29b38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:11.640576 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-315b6714-c29e-45ba-8949-4dd2eae29b38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:11.641594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-315b6714-c29e-45ba-8949-4dd2eae29b38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:11.641825 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-315b6714-c29e-45ba-8949-4dd2eae29b38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:11.642234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-315b6714-c29e-45ba-8949-4dd2eae29b38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:11.814064 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-315b6714-c29e-45ba-8949-4dd2eae29b38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:11.827837 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-315b6714-c29e-45ba-8949-4dd2eae29b38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.197223 Oct 27 17:31:11.829665 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 61/121] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:11 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:11.836114 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4cef287a-f239-4da1-8353-52cecba90754 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:11.836735 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4cef287a-f239-4da1-8353-52cecba90754 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:11.846981 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4cef287a-f239-4da1-8353-52cecba90754 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:11.847482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4cef287a-f239-4da1-8353-52cecba90754 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:11.847957 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4cef287a-f239-4da1-8353-52cecba90754 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:11.848660 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4cef287a-f239-4da1-8353-52cecba90754 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:11.849115 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4cef287a-f239-4da1-8353-52cecba90754 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:11.849544 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4cef287a-f239-4da1-8353-52cecba90754 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:11.855199 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-9bd651af-685b-46a8-9303-fa2cd57be009 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:11.856009 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-9bd651af-685b-46a8-9303-fa2cd57be009 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:11.878438 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9bd651af-685b-46a8-9303-fa2cd57be009 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:11.882743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9bd651af-685b-46a8-9303-fa2cd57be009 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:11.883847 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9bd651af-685b-46a8-9303-fa2cd57be009 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:11.886163 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9bd651af-685b-46a8-9303-fa2cd57be009 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:11.886636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9bd651af-685b-46a8-9303-fa2cd57be009 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:11.889200 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9bd651af-685b-46a8-9303-fa2cd57be009 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:12.068005 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4cef287a-f239-4da1-8353-52cecba90754 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:12.085200 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4cef287a-f239-4da1-8353-52cecba90754 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:12.086772 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4cef287a-f239-4da1-8353-52cecba90754 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:12.088440 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4cef287a-f239-4da1-8353-52cecba90754 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.256108 Oct 27 17:31:12.088979 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 61/122] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:11 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:12.143273 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9bd651af-685b-46a8-9303-fa2cd57be009 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:12.151905 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-9bd651af-685b-46a8-9303-fa2cd57be009 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.301935 Oct 27 17:31:12.152597 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 62/123] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:11 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:12.176523 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-93b7e837-db9d-4e2b-977c-ec74cd1466cc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:12.177603 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-93b7e837-db9d-4e2b-977c-ec74cd1466cc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:12.184828 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93b7e837-db9d-4e2b-977c-ec74cd1466cc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:12.185662 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93b7e837-db9d-4e2b-977c-ec74cd1466cc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:12.186561 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93b7e837-db9d-4e2b-977c-ec74cd1466cc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:12.187735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93b7e837-db9d-4e2b-977c-ec74cd1466cc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:12.188402 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93b7e837-db9d-4e2b-977c-ec74cd1466cc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:12.189370 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93b7e837-db9d-4e2b-977c-ec74cd1466cc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:12.255193 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-3080989d-5516-4d9a-b199-7b344eb96436 req-b4454a0e-78cf-4811-807a-ad4c660c712b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6f4324-0826-4b60-b1b5-a7d00c63cdec", "name": "network-vif-plugged", "status": "completed", "tag": "dd5472a4-a592-4461-977c-b241c99f30b9"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:31:12.275411 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-3080989d-5516-4d9a-b199-7b344eb96436 req-b4454a0e-78cf-4811-807a-ad4c660c712b service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:12.275963 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-3080989d-5516-4d9a-b199-7b344eb96436 req-b4454a0e-78cf-4811-807a-ad4c660c712b service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:12.277102 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-3080989d-5516-4d9a-b199-7b344eb96436 req-b4454a0e-78cf-4811-807a-ad4c660c712b service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:12.305364 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-3080989d-5516-4d9a-b199-7b344eb96436 req-b4454a0e-78cf-4811-807a-ad4c660c712b service nova] Creating event network-vif-plugged:dd5472a4-a592-4461-977c-b241c99f30b9 for instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec on hv-cinder-86283 Oct 27 17:31:12.320971 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-3080989d-5516-4d9a-b199-7b344eb96436 req-b4454a0e-78cf-4811-807a-ad4c660c712b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227628 Oct 27 17:31:12.322843 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 62/124] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:31:12.341152 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2acef52a-46ed-4615-9391-729eb6f9c7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:12.342251 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2acef52a-46ed-4615-9391-729eb6f9c7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:12.355008 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2acef52a-46ed-4615-9391-729eb6f9c7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:12.357788 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2acef52a-46ed-4615-9391-729eb6f9c7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:12.358830 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2acef52a-46ed-4615-9391-729eb6f9c7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:12.359567 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2acef52a-46ed-4615-9391-729eb6f9c7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:12.360060 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2acef52a-46ed-4615-9391-729eb6f9c7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:12.367816 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2acef52a-46ed-4615-9391-729eb6f9c7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:12.693599 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2acef52a-46ed-4615-9391-729eb6f9c7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:12.703019 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2acef52a-46ed-4615-9391-729eb6f9c7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.378433 Oct 27 17:31:12.704144 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 63/125] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:12 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:12.811591 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-93b7e837-db9d-4e2b-977c-ec74cd1466cc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:12.830306 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-93b7e837-db9d-4e2b-977c-ec74cd1466cc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.658266 Oct 27 17:31:12.833913 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 63/126] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:12 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:12.853165 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-c9ce0a90-cee6-4197-87ad-11227d992f9a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:12.853772 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c9ce0a90-cee6-4197-87ad-11227d992f9a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:12.860065 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c9ce0a90-cee6-4197-87ad-11227d992f9a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:12.860806 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c9ce0a90-cee6-4197-87ad-11227d992f9a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:12.861232 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c9ce0a90-cee6-4197-87ad-11227d992f9a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:12.861918 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c9ce0a90-cee6-4197-87ad-11227d992f9a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:12.862357 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c9ce0a90-cee6-4197-87ad-11227d992f9a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:12.862802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c9ce0a90-cee6-4197-87ad-11227d992f9a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:13.004663 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-c9ce0a90-cee6-4197-87ad-11227d992f9a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:13.012757 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-c9ce0a90-cee6-4197-87ad-11227d992f9a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.163352 Oct 27 17:31:13.013328 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 64/127] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:12 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:13.117173 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6d510e79-82ef-45e1-9fca-bbabf281aae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:13.117814 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-6d510e79-82ef-45e1-9fca-bbabf281aae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:13.123990 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6d510e79-82ef-45e1-9fca-bbabf281aae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:13.124480 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6d510e79-82ef-45e1-9fca-bbabf281aae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:13.125162 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6d510e79-82ef-45e1-9fca-bbabf281aae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:13.125829 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6d510e79-82ef-45e1-9fca-bbabf281aae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:13.126347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6d510e79-82ef-45e1-9fca-bbabf281aae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:13.126832 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6d510e79-82ef-45e1-9fca-bbabf281aae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:13.176250 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e76ecad6-189c-47a6-87f4-24d4b015ed0b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:13.177111 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e76ecad6-189c-47a6-87f4-24d4b015ed0b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:13.183511 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e76ecad6-189c-47a6-87f4-24d4b015ed0b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:13.184030 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e76ecad6-189c-47a6-87f4-24d4b015ed0b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:13.184460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e76ecad6-189c-47a6-87f4-24d4b015ed0b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:13.185148 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e76ecad6-189c-47a6-87f4-24d4b015ed0b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:13.185591 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e76ecad6-189c-47a6-87f4-24d4b015ed0b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:13.186005 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e76ecad6-189c-47a6-87f4-24d4b015ed0b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:13.276976 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-6d510e79-82ef-45e1-9fca-bbabf281aae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:13.285311 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-6d510e79-82ef-45e1-9fca-bbabf281aae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:13.286763 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-6d510e79-82ef-45e1-9fca-bbabf281aae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:13.287902 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6d510e79-82ef-45e1-9fca-bbabf281aae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.174953 Oct 27 17:31:13.288470 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 64/128] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:13 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:13.380086 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e76ecad6-189c-47a6-87f4-24d4b015ed0b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:13.388513 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e76ecad6-189c-47a6-87f4-24d4b015ed0b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.217181 Oct 27 17:31:13.389245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 65/129] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:13 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:13.727977 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-aa7f2d05-15f0-4320-996f-6ffe7e7d7dfb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:13.727977 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-aa7f2d05-15f0-4320-996f-6ffe7e7d7dfb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:13.734570 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aa7f2d05-15f0-4320-996f-6ffe7e7d7dfb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:13.735335 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aa7f2d05-15f0-4320-996f-6ffe7e7d7dfb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:13.736071 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aa7f2d05-15f0-4320-996f-6ffe7e7d7dfb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:13.736872 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aa7f2d05-15f0-4320-996f-6ffe7e7d7dfb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:13.737563 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aa7f2d05-15f0-4320-996f-6ffe7e7d7dfb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:13.738180 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aa7f2d05-15f0-4320-996f-6ffe7e7d7dfb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:13.866930 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-04f01f59-a144-4021-a2a2-8a37167a5342 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:13.870552 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-04f01f59-a144-4021-a2a2-8a37167a5342 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:13.879738 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-04f01f59-a144-4021-a2a2-8a37167a5342 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:13.880556 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-04f01f59-a144-4021-a2a2-8a37167a5342 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:13.881447 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-04f01f59-a144-4021-a2a2-8a37167a5342 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:13.883693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-04f01f59-a144-4021-a2a2-8a37167a5342 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:13.884442 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-04f01f59-a144-4021-a2a2-8a37167a5342 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:13.885377 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-04f01f59-a144-4021-a2a2-8a37167a5342 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:13.904132 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-aa7f2d05-15f0-4320-996f-6ffe7e7d7dfb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:13.913228 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-aa7f2d05-15f0-4320-996f-6ffe7e7d7dfb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.190251 Oct 27 17:31:13.915269 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 65/130] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:13 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:14.036454 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-fb20518d-7ae6-4f2b-aa56-6c2dc516a943 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:14.037458 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-fb20518d-7ae6-4f2b-aa56-6c2dc516a943 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:14.044194 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fb20518d-7ae6-4f2b-aa56-6c2dc516a943 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:14.045137 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fb20518d-7ae6-4f2b-aa56-6c2dc516a943 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:14.045721 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fb20518d-7ae6-4f2b-aa56-6c2dc516a943 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:14.046569 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fb20518d-7ae6-4f2b-aa56-6c2dc516a943 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:14.047169 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fb20518d-7ae6-4f2b-aa56-6c2dc516a943 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:14.047898 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fb20518d-7ae6-4f2b-aa56-6c2dc516a943 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:14.108672 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-04f01f59-a144-4021-a2a2-8a37167a5342 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:14.118161 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-04f01f59-a144-4021-a2a2-8a37167a5342 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.263412 Oct 27 17:31:14.120112 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 66/131] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:13 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:14.248518 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fb20518d-7ae6-4f2b-aa56-6c2dc516a943 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:14.259402 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-fb20518d-7ae6-4f2b-aa56-6c2dc516a943 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.225962 Oct 27 17:31:14.260300 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 66/132] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:14 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:14.315341 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7ce5084b-9331-4d7a-b00e-62d5e5053871 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:14.316842 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7ce5084b-9331-4d7a-b00e-62d5e5053871 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:14.330945 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7ce5084b-9331-4d7a-b00e-62d5e5053871 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:14.331679 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7ce5084b-9331-4d7a-b00e-62d5e5053871 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:14.332440 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7ce5084b-9331-4d7a-b00e-62d5e5053871 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:14.333301 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7ce5084b-9331-4d7a-b00e-62d5e5053871 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:14.334896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7ce5084b-9331-4d7a-b00e-62d5e5053871 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:14.335478 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7ce5084b-9331-4d7a-b00e-62d5e5053871 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:14.373217 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-d381128c-c020-4b31-b774-5e7164a427b4 req-3c25e1d7-aaec-4d88-a9a9-7f9805489c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7238287c-af11-4c20-96cf-8ee9e4b34e8a", "name": "network-vif-plugged", "status": "completed", "tag": "a9b83ac3-e8af-444b-9748-299c30d1dd1d"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:31:14.389208 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-d381128c-c020-4b31-b774-5e7164a427b4 req-3c25e1d7-aaec-4d88-a9a9-7f9805489c14 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:14.389684 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-d381128c-c020-4b31-b774-5e7164a427b4 req-3c25e1d7-aaec-4d88-a9a9-7f9805489c14 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:14.390284 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-d381128c-c020-4b31-b774-5e7164a427b4 req-3c25e1d7-aaec-4d88-a9a9-7f9805489c14 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:14.403290 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-d381128c-c020-4b31-b774-5e7164a427b4 req-3c25e1d7-aaec-4d88-a9a9-7f9805489c14 service nova] Creating event network-vif-plugged:a9b83ac3-e8af-444b-9748-299c30d1dd1d for instance 7238287c-af11-4c20-96cf-8ee9e4b34e8a on hv-cinder-86283 Oct 27 17:31:14.409123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-d381128c-c020-4b31-b774-5e7164a427b4 req-3c25e1d7-aaec-4d88-a9a9-7f9805489c14 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040468 Oct 27 17:31:14.411051 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 67/133] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:31:14.422281 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8a43c315-02e6-411b-94a4-0b7a6c13aa80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:14.423147 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8a43c315-02e6-411b-94a4-0b7a6c13aa80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:14.431272 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a43c315-02e6-411b-94a4-0b7a6c13aa80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:14.431698 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a43c315-02e6-411b-94a4-0b7a6c13aa80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:14.432319 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a43c315-02e6-411b-94a4-0b7a6c13aa80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:14.433079 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a43c315-02e6-411b-94a4-0b7a6c13aa80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:14.433451 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a43c315-02e6-411b-94a4-0b7a6c13aa80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:14.434098 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a43c315-02e6-411b-94a4-0b7a6c13aa80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:14.557189 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7ce5084b-9331-4d7a-b00e-62d5e5053871 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:14.566159 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7ce5084b-9331-4d7a-b00e-62d5e5053871 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:14.568504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7ce5084b-9331-4d7a-b00e-62d5e5053871 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:14.569626 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7ce5084b-9331-4d7a-b00e-62d5e5053871 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.259677 Oct 27 17:31:14.570222 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 67/134] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:14 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:14.617508 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8a43c315-02e6-411b-94a4-0b7a6c13aa80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:14.630462 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8a43c315-02e6-411b-94a4-0b7a6c13aa80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.213514 Oct 27 17:31:14.644784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 68/135] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:14 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:14.938258 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e1190cd2-a58b-43ec-8745-6a7fa282cb57 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:14.941517 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e1190cd2-a58b-43ec-8745-6a7fa282cb57 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:14.958761 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1190cd2-a58b-43ec-8745-6a7fa282cb57 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:14.963381 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1190cd2-a58b-43ec-8745-6a7fa282cb57 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:14.964186 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1190cd2-a58b-43ec-8745-6a7fa282cb57 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:14.966379 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1190cd2-a58b-43ec-8745-6a7fa282cb57 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:14.968285 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1190cd2-a58b-43ec-8745-6a7fa282cb57 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:14.969307 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1190cd2-a58b-43ec-8745-6a7fa282cb57 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:15.146501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-15ff02df-154d-484e-80e2-2474f4693207 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:15.147018 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-15ff02df-154d-484e-80e2-2474f4693207 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:15.153383 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15ff02df-154d-484e-80e2-2474f4693207 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:15.153867 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15ff02df-154d-484e-80e2-2474f4693207 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:15.154488 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15ff02df-154d-484e-80e2-2474f4693207 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:15.155342 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15ff02df-154d-484e-80e2-2474f4693207 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:15.155910 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15ff02df-154d-484e-80e2-2474f4693207 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:15.156353 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15ff02df-154d-484e-80e2-2474f4693207 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:15.593338 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e1190cd2-a58b-43ec-8745-6a7fa282cb57 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:15.609383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e1190cd2-a58b-43ec-8745-6a7fa282cb57 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.675277 Oct 27 17:31:15.630255 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 68/136] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:14 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:15.635459 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9ee44b0a-396f-470f-b3ab-152d63f66723 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:15.637223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9ee44b0a-396f-470f-b3ab-152d63f66723 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:15.647658 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9ee44b0a-396f-470f-b3ab-152d63f66723 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:15.648347 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9ee44b0a-396f-470f-b3ab-152d63f66723 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:15.648838 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9ee44b0a-396f-470f-b3ab-152d63f66723 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:15.650735 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9ee44b0a-396f-470f-b3ab-152d63f66723 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:15.650735 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9ee44b0a-396f-470f-b3ab-152d63f66723 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:15.650735 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9ee44b0a-396f-470f-b3ab-152d63f66723 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:15.822921 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-15ff02df-154d-484e-80e2-2474f4693207 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:15.839844 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-15ff02df-154d-484e-80e2-2474f4693207 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.695615 Oct 27 17:31:15.841351 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 69/137] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:15 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:15.848831 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f3d55edc-c2d9-498c-8b61-a0075281b6b7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:15.850032 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f3d55edc-c2d9-498c-8b61-a0075281b6b7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:15.865149 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f3d55edc-c2d9-498c-8b61-a0075281b6b7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:15.865801 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f3d55edc-c2d9-498c-8b61-a0075281b6b7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:15.866858 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f3d55edc-c2d9-498c-8b61-a0075281b6b7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:15.867807 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f3d55edc-c2d9-498c-8b61-a0075281b6b7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:15.869134 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f3d55edc-c2d9-498c-8b61-a0075281b6b7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:15.869979 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f3d55edc-c2d9-498c-8b61-a0075281b6b7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:16.170808 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9ee44b0a-396f-470f-b3ab-152d63f66723 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:16.183057 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9ee44b0a-396f-470f-b3ab-152d63f66723 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.551290 Oct 27 17:31:16.186872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 69/138] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:15 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:16.200151 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-5ffc916a-602b-4c9d-b79b-66a41f239cc2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:16.201910 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-5ffc916a-602b-4c9d-b79b-66a41f239cc2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:16.216739 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5ffc916a-602b-4c9d-b79b-66a41f239cc2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:16.218229 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5ffc916a-602b-4c9d-b79b-66a41f239cc2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:16.221048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5ffc916a-602b-4c9d-b79b-66a41f239cc2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:16.226554 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5ffc916a-602b-4c9d-b79b-66a41f239cc2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:16.226680 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f3d55edc-c2d9-498c-8b61-a0075281b6b7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:16.227111 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5ffc916a-602b-4c9d-b79b-66a41f239cc2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:16.227484 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5ffc916a-602b-4c9d-b79b-66a41f239cc2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:16.244203 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f3d55edc-c2d9-498c-8b61-a0075281b6b7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:16.246201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f3d55edc-c2d9-498c-8b61-a0075281b6b7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:16.248030 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f3d55edc-c2d9-498c-8b61-a0075281b6b7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.404890 Oct 27 17:31:16.259620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 70/139] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:15 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:16.414175 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5ffc916a-602b-4c9d-b79b-66a41f239cc2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:16.418529 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=100 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:31:16.425259 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-5ffc916a-602b-4c9d-b79b-66a41f239cc2 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.236604 Oct 27 17:31:16.425836 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 70/140] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:16 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:16.444992 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-c8e64352-5172-4939-a495-88764b0dccec req-246da798-af5a-4980-879b-2d1bee3859a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b27a822-4c22-45f0-872b-67e5f360f45e", "name": "network-vif-plugged", "status": "completed", "tag": "8d525473-0013-4431-baf7-e343fbc1a2eb"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:31:16.460887 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-c8e64352-5172-4939-a495-88764b0dccec req-246da798-af5a-4980-879b-2d1bee3859a1 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:16.461622 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-c8e64352-5172-4939-a495-88764b0dccec req-246da798-af5a-4980-879b-2d1bee3859a1 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:16.462449 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-c8e64352-5172-4939-a495-88764b0dccec req-246da798-af5a-4980-879b-2d1bee3859a1 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:16.478746 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-c8e64352-5172-4939-a495-88764b0dccec req-246da798-af5a-4980-879b-2d1bee3859a1 service nova] Creating event network-vif-plugged:8d525473-0013-4431-baf7-e343fbc1a2eb for instance 2b27a822-4c22-45f0-872b-67e5f360f45e on hv-cinder-86283 Oct 27 17:31:16.484258 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-c8e64352-5172-4939-a495-88764b0dccec req-246da798-af5a-4980-879b-2d1bee3859a1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045648 Oct 27 17:31:16.484932 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 71/141] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:31:16.638479 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0793d194-ba15-41df-9eb7-74a2aef2b429 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:16.639131 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-0793d194-ba15-41df-9eb7-74a2aef2b429 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:16.645376 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0793d194-ba15-41df-9eb7-74a2aef2b429 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:16.645860 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0793d194-ba15-41df-9eb7-74a2aef2b429 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:16.646313 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0793d194-ba15-41df-9eb7-74a2aef2b429 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:16.647179 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0793d194-ba15-41df-9eb7-74a2aef2b429 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:16.647645 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0793d194-ba15-41df-9eb7-74a2aef2b429 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:16.648102 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0793d194-ba15-41df-9eb7-74a2aef2b429 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:16.827020 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0793d194-ba15-41df-9eb7-74a2aef2b429 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:16.836599 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0793d194-ba15-41df-9eb7-74a2aef2b429 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.202765 Oct 27 17:31:16.837625 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 71/142] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:16 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:16.869980 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-81d3887a-9344-47b0-8f73-ab839fb47644 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:16.871215 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-81d3887a-9344-47b0-8f73-ab839fb47644 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:16.885687 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81d3887a-9344-47b0-8f73-ab839fb47644 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:16.886175 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81d3887a-9344-47b0-8f73-ab839fb47644 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:16.886604 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81d3887a-9344-47b0-8f73-ab839fb47644 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:16.887298 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81d3887a-9344-47b0-8f73-ab839fb47644 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:16.887759 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81d3887a-9344-47b0-8f73-ab839fb47644 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:16.888184 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81d3887a-9344-47b0-8f73-ab839fb47644 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:17.052770 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-81d3887a-9344-47b0-8f73-ab839fb47644 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:17.056294 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=100 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:31:17.064411 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-81d3887a-9344-47b0-8f73-ab839fb47644 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.200524 Oct 27 17:31:17.064980 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 72/143] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:16 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:17.208224 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ae97cf2a-c620-4dc3-8783-c4789e049763 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:17.208757 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ae97cf2a-c620-4dc3-8783-c4789e049763 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:17.214712 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ae97cf2a-c620-4dc3-8783-c4789e049763 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:17.215194 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ae97cf2a-c620-4dc3-8783-c4789e049763 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:17.215621 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ae97cf2a-c620-4dc3-8783-c4789e049763 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:17.216346 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ae97cf2a-c620-4dc3-8783-c4789e049763 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:17.216790 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ae97cf2a-c620-4dc3-8783-c4789e049763 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:17.217205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ae97cf2a-c620-4dc3-8783-c4789e049763 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:17.275330 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-94d06334-a329-4bfe-9380-a6b23e7d060f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:17.275981 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-94d06334-a329-4bfe-9380-a6b23e7d060f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:17.282357 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-94d06334-a329-4bfe-9380-a6b23e7d060f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:17.282845 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-94d06334-a329-4bfe-9380-a6b23e7d060f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:17.283274 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-94d06334-a329-4bfe-9380-a6b23e7d060f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:17.284002 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-94d06334-a329-4bfe-9380-a6b23e7d060f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:17.285032 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-94d06334-a329-4bfe-9380-a6b23e7d060f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:17.285485 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-94d06334-a329-4bfe-9380-a6b23e7d060f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:17.365833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ae97cf2a-c620-4dc3-8783-c4789e049763 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:17.375813 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ae97cf2a-c620-4dc3-8783-c4789e049763 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.171927 Oct 27 17:31:17.376972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 72/144] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:17 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:17.432493 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-94d06334-a329-4bfe-9380-a6b23e7d060f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:17.440432 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-94d06334-a329-4bfe-9380-a6b23e7d060f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:17.442379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-94d06334-a329-4bfe-9380-a6b23e7d060f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:17.443567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-94d06334-a329-4bfe-9380-a6b23e7d060f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.172074 Oct 27 17:31:17.444310 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 73/145] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:17 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:31:17.448513 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2a95cfa4-6f78-47e7-8ec3-e068202c1bed tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:17.449220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2a95cfa4-6f78-47e7-8ec3-e068202c1bed tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:17.455298 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2a95cfa4-6f78-47e7-8ec3-e068202c1bed tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:17.455998 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2a95cfa4-6f78-47e7-8ec3-e068202c1bed tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:17.456489 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2a95cfa4-6f78-47e7-8ec3-e068202c1bed tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:17.457383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2a95cfa4-6f78-47e7-8ec3-e068202c1bed tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:17.457863 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2a95cfa4-6f78-47e7-8ec3-e068202c1bed tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:17.458455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2a95cfa4-6f78-47e7-8ec3-e068202c1bed tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:17.598743 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2a95cfa4-6f78-47e7-8ec3-e068202c1bed tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:17.607127 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2a95cfa4-6f78-47e7-8ec3-e068202c1bed tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.162110 Oct 27 17:31:17.607702 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 73/146] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:17 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:17.861578 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f2a48598-3bac-458e-be5c-0c859b3eaec2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:17.862175 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f2a48598-3bac-458e-be5c-0c859b3eaec2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:17.868586 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2a48598-3bac-458e-be5c-0c859b3eaec2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:17.869075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2a48598-3bac-458e-be5c-0c859b3eaec2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:17.869514 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2a48598-3bac-458e-be5c-0c859b3eaec2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:17.870205 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2a48598-3bac-458e-be5c-0c859b3eaec2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:17.870660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2a48598-3bac-458e-be5c-0c859b3eaec2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:17.871086 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2a48598-3bac-458e-be5c-0c859b3eaec2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:18.062283 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f2a48598-3bac-458e-be5c-0c859b3eaec2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:18.071543 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f2a48598-3bac-458e-be5c-0c859b3eaec2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.213775 Oct 27 17:31:18.076208 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 74/147] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:17 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:18.087088 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-aeaa1eee-fdf8-441b-8bd0-b4a4ddc489e4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:18.087982 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-aeaa1eee-fdf8-441b-8bd0-b4a4ddc489e4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:18.096519 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aeaa1eee-fdf8-441b-8bd0-b4a4ddc489e4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:18.102669 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aeaa1eee-fdf8-441b-8bd0-b4a4ddc489e4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:18.103145 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aeaa1eee-fdf8-441b-8bd0-b4a4ddc489e4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:18.103918 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aeaa1eee-fdf8-441b-8bd0-b4a4ddc489e4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:18.104386 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aeaa1eee-fdf8-441b-8bd0-b4a4ddc489e4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:18.104814 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aeaa1eee-fdf8-441b-8bd0-b4a4ddc489e4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:18.291047 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-aeaa1eee-fdf8-441b-8bd0-b4a4ddc489e4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:18.299337 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-aeaa1eee-fdf8-441b-8bd0-b4a4ddc489e4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.216451 Oct 27 17:31:18.299972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 74/148] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:18 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:18.398518 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c5ad79e5-23ea-4237-a506-333d709975ad tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:18.399275 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c5ad79e5-23ea-4237-a506-333d709975ad tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:18.406281 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c5ad79e5-23ea-4237-a506-333d709975ad tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:18.406778 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c5ad79e5-23ea-4237-a506-333d709975ad tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:18.407214 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c5ad79e5-23ea-4237-a506-333d709975ad tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:18.407968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c5ad79e5-23ea-4237-a506-333d709975ad tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:18.408424 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c5ad79e5-23ea-4237-a506-333d709975ad tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:18.408850 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c5ad79e5-23ea-4237-a506-333d709975ad tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:18.468931 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-54a4c71b-ffd4-4dce-90f1-eeccba1b3b09 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:18.469547 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-54a4c71b-ffd4-4dce-90f1-eeccba1b3b09 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:18.484559 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-54a4c71b-ffd4-4dce-90f1-eeccba1b3b09 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:18.484974 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-54a4c71b-ffd4-4dce-90f1-eeccba1b3b09 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:18.485413 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-54a4c71b-ffd4-4dce-90f1-eeccba1b3b09 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:18.486119 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-54a4c71b-ffd4-4dce-90f1-eeccba1b3b09 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:18.486573 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-54a4c71b-ffd4-4dce-90f1-eeccba1b3b09 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:18.486993 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-54a4c71b-ffd4-4dce-90f1-eeccba1b3b09 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:18.574525 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c5ad79e5-23ea-4237-a506-333d709975ad tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:18.582306 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c5ad79e5-23ea-4237-a506-333d709975ad tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.187712 Oct 27 17:31:18.582904 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 75/149] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:18 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:18.588405 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-2562ba50-c507-491a-a7bc-219390a4bc69 req-a180ef82-cd18-4961-b172-137051259115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9f11af-ebc7-4b43-80e4-e03e24ae3490", "name": "network-vif-plugged", "status": "completed", "tag": "689c3b28-8322-4e68-94df-67c69ac85d72"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:31:18.598052 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-2562ba50-c507-491a-a7bc-219390a4bc69 req-a180ef82-cd18-4961-b172-137051259115 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:18.598527 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-2562ba50-c507-491a-a7bc-219390a4bc69 req-a180ef82-cd18-4961-b172-137051259115 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:18.599161 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-2562ba50-c507-491a-a7bc-219390a4bc69 req-a180ef82-cd18-4961-b172-137051259115 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:18.611883 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-2562ba50-c507-491a-a7bc-219390a4bc69 req-a180ef82-cd18-4961-b172-137051259115 service nova] Creating event network-vif-plugged:689c3b28-8322-4e68-94df-67c69ac85d72 for instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 on hv-cinder-86283 Oct 27 17:31:18.617626 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-2562ba50-c507-491a-a7bc-219390a4bc69 req-a180ef82-cd18-4961-b172-137051259115 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033448 Oct 27 17:31:18.618376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 76/150] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:31:18.630646 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c716d79e-cfd5-4019-b318-ed83282360e5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:18.631613 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c716d79e-cfd5-4019-b318-ed83282360e5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:18.638064 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c716d79e-cfd5-4019-b318-ed83282360e5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:18.638554 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c716d79e-cfd5-4019-b318-ed83282360e5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:18.638986 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c716d79e-cfd5-4019-b318-ed83282360e5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:18.639670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c716d79e-cfd5-4019-b318-ed83282360e5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:18.640153 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c716d79e-cfd5-4019-b318-ed83282360e5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:18.640576 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c716d79e-cfd5-4019-b318-ed83282360e5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:18.802424 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c716d79e-cfd5-4019-b318-ed83282360e5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:18.812033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c716d79e-cfd5-4019-b318-ed83282360e5 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.185357 Oct 27 17:31:18.813450 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 77/151] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:18 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:19.094704 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4fae6c90-3558-4e32-980a-5775ffa7203b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:19.095398 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4fae6c90-3558-4e32-980a-5775ffa7203b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:19.101989 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fae6c90-3558-4e32-980a-5775ffa7203b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:19.102544 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fae6c90-3558-4e32-980a-5775ffa7203b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:19.103048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fae6c90-3558-4e32-980a-5775ffa7203b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:19.103827 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fae6c90-3558-4e32-980a-5775ffa7203b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:19.104352 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fae6c90-3558-4e32-980a-5775ffa7203b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:19.104872 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fae6c90-3558-4e32-980a-5775ffa7203b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:19.267180 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4fae6c90-3558-4e32-980a-5775ffa7203b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:19.279819 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4fae6c90-3558-4e32-980a-5775ffa7203b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.188782 Oct 27 17:31:19.280416 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 78/152] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:19 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:19.333502 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2e6e2a61-7dba-406e-b641-47fefe4b4faa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:19.334657 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2e6e2a61-7dba-406e-b641-47fefe4b4faa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:19.335409 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-54a4c71b-ffd4-4dce-90f1-eeccba1b3b09 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:19.345053 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e6e2a61-7dba-406e-b641-47fefe4b4faa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:19.345992 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e6e2a61-7dba-406e-b641-47fefe4b4faa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:19.347403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e6e2a61-7dba-406e-b641-47fefe4b4faa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:19.348296 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e6e2a61-7dba-406e-b641-47fefe4b4faa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:19.349278 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e6e2a61-7dba-406e-b641-47fefe4b4faa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:19.349908 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-54a4c71b-ffd4-4dce-90f1-eeccba1b3b09 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:19.350164 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e6e2a61-7dba-406e-b641-47fefe4b4faa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:19.357371 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-54a4c71b-ffd4-4dce-90f1-eeccba1b3b09 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:19.360367 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-54a4c71b-ffd4-4dce-90f1-eeccba1b3b09 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.895274 Oct 27 17:31:19.361798 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 75/153] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:18 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:31:19.580146 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2e6e2a61-7dba-406e-b641-47fefe4b4faa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:19.588625 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2e6e2a61-7dba-406e-b641-47fefe4b4faa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.269000 Oct 27 17:31:19.603735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 79/154] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:19 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:19.606074 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0218f73c-5c5e-43cf-9916-a0cf4d1ea020 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:19.606979 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-0218f73c-5c5e-43cf-9916-a0cf4d1ea020 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:19.608952 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=97 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:31:19.614320 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0218f73c-5c5e-43cf-9916-a0cf4d1ea020 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:19.614804 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0218f73c-5c5e-43cf-9916-a0cf4d1ea020 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:19.615249 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0218f73c-5c5e-43cf-9916-a0cf4d1ea020 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:19.615945 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0218f73c-5c5e-43cf-9916-a0cf4d1ea020 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:19.616412 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0218f73c-5c5e-43cf-9916-a0cf4d1ea020 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:19.616810 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0218f73c-5c5e-43cf-9916-a0cf4d1ea020 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:19.832455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0218f73c-5c5e-43cf-9916-a0cf4d1ea020 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:19.837550 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2ac4dd19-beb8-49ff-b236-36df7aacb813 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:19.838775 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2ac4dd19-beb8-49ff-b236-36df7aacb813 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:19.840572 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0218f73c-5c5e-43cf-9916-a0cf4d1ea020 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.238899 Oct 27 17:31:19.841527 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 76/155] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:19 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:19.845142 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ac4dd19-beb8-49ff-b236-36df7aacb813 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:19.845698 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ac4dd19-beb8-49ff-b236-36df7aacb813 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:19.846246 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ac4dd19-beb8-49ff-b236-36df7aacb813 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:19.847091 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ac4dd19-beb8-49ff-b236-36df7aacb813 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:19.847603 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ac4dd19-beb8-49ff-b236-36df7aacb813 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:19.848109 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2ac4dd19-beb8-49ff-b236-36df7aacb813 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:20.052099 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2ac4dd19-beb8-49ff-b236-36df7aacb813 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:20.060480 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2ac4dd19-beb8-49ff-b236-36df7aacb813 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.227727 Oct 27 17:31:20.076808 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 80/156] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:19 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:20.303389 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3640f84c-9f0b-4585-ad54-87b385d2a1e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:20.304207 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-3640f84c-9f0b-4585-ad54-87b385d2a1e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:20.311138 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3640f84c-9f0b-4585-ad54-87b385d2a1e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:20.311764 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3640f84c-9f0b-4585-ad54-87b385d2a1e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:20.312221 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3640f84c-9f0b-4585-ad54-87b385d2a1e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:20.312975 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3640f84c-9f0b-4585-ad54-87b385d2a1e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:20.313576 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3640f84c-9f0b-4585-ad54-87b385d2a1e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:20.314196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3640f84c-9f0b-4585-ad54-87b385d2a1e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:20.392420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-486c4245-a6a7-451d-9e6a-6b3677591f20 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:20.393335 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-486c4245-a6a7-451d-9e6a-6b3677591f20 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:20.399875 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-486c4245-a6a7-451d-9e6a-6b3677591f20 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:20.400560 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-486c4245-a6a7-451d-9e6a-6b3677591f20 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:20.401141 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-486c4245-a6a7-451d-9e6a-6b3677591f20 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:20.402204 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-486c4245-a6a7-451d-9e6a-6b3677591f20 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:20.403365 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-486c4245-a6a7-451d-9e6a-6b3677591f20 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:20.404131 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-486c4245-a6a7-451d-9e6a-6b3677591f20 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:20.493399 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-3640f84c-9f0b-4585-ad54-87b385d2a1e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:20.506310 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-3640f84c-9f0b-4585-ad54-87b385d2a1e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.206850 Oct 27 17:31:20.507236 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 77/157] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:20 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:20.609449 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-486c4245-a6a7-451d-9e6a-6b3677591f20 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:20.613280 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4525db9c-c760-4f79-ae9a-6984fdf20197 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:20.614139 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4525db9c-c760-4f79-ae9a-6984fdf20197 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:20.620306 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4525db9c-c760-4f79-ae9a-6984fdf20197 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:20.625728 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4525db9c-c760-4f79-ae9a-6984fdf20197 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:20.629088 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4525db9c-c760-4f79-ae9a-6984fdf20197 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:20.630243 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4525db9c-c760-4f79-ae9a-6984fdf20197 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:20.631256 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4525db9c-c760-4f79-ae9a-6984fdf20197 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:20.631896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4525db9c-c760-4f79-ae9a-6984fdf20197 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:20.637082 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-486c4245-a6a7-451d-9e6a-6b3677591f20 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:20.638709 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-486c4245-a6a7-451d-9e6a-6b3677591f20 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:20.640342 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-486c4245-a6a7-451d-9e6a-6b3677591f20 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.251869 Oct 27 17:31:20.641137 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 81/158] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:20 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:31:20.828563 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4525db9c-c760-4f79-ae9a-6984fdf20197 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:20.838704 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4525db9c-c760-4f79-ae9a-6984fdf20197 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.229676 Oct 27 17:31:20.840594 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 78/159] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:20 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:20.870322 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-df6fe555-bb5f-4b26-a04d-c1b4d2b84ecd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:20.871237 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-df6fe555-bb5f-4b26-a04d-c1b4d2b84ecd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:20.882192 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df6fe555-bb5f-4b26-a04d-c1b4d2b84ecd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:20.882645 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df6fe555-bb5f-4b26-a04d-c1b4d2b84ecd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:20.883173 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df6fe555-bb5f-4b26-a04d-c1b4d2b84ecd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:20.887684 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df6fe555-bb5f-4b26-a04d-c1b4d2b84ecd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:20.890059 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df6fe555-bb5f-4b26-a04d-c1b4d2b84ecd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:20.890469 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df6fe555-bb5f-4b26-a04d-c1b4d2b84ecd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:21.074440 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-df6fe555-bb5f-4b26-a04d-c1b4d2b84ecd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:21.084015 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-df6fe555-bb5f-4b26-a04d-c1b4d2b84ecd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.218328 Oct 27 17:31:21.084840 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 82/160] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:20 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:21.089330 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-789949d8-0b12-4bd9-aeaf-b818cc77a4f4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:21.089985 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-789949d8-0b12-4bd9-aeaf-b818cc77a4f4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:21.097883 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-789949d8-0b12-4bd9-aeaf-b818cc77a4f4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:21.098996 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-789949d8-0b12-4bd9-aeaf-b818cc77a4f4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:21.099897 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-789949d8-0b12-4bd9-aeaf-b818cc77a4f4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:21.100704 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-789949d8-0b12-4bd9-aeaf-b818cc77a4f4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:21.101184 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-789949d8-0b12-4bd9-aeaf-b818cc77a4f4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:21.101662 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-789949d8-0b12-4bd9-aeaf-b818cc77a4f4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:21.246024 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-789949d8-0b12-4bd9-aeaf-b818cc77a4f4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:21.255597 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-789949d8-0b12-4bd9-aeaf-b818cc77a4f4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.174351 Oct 27 17:31:21.256366 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 79/161] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:21 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:21.529383 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-24d48840-981d-4493-a2ff-d9576d792490 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:21.530116 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-24d48840-981d-4493-a2ff-d9576d792490 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:21.536296 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-24d48840-981d-4493-a2ff-d9576d792490 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:21.537125 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-24d48840-981d-4493-a2ff-d9576d792490 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:21.538738 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-24d48840-981d-4493-a2ff-d9576d792490 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:21.539390 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-24d48840-981d-4493-a2ff-d9576d792490 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:21.539885 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-24d48840-981d-4493-a2ff-d9576d792490 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:21.540317 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-24d48840-981d-4493-a2ff-d9576d792490 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:21.665865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-60f05f58-60a5-4761-869b-a880b9318295 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:21.666563 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-60f05f58-60a5-4761-869b-a880b9318295 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:21.673385 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60f05f58-60a5-4761-869b-a880b9318295 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:21.673876 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60f05f58-60a5-4761-869b-a880b9318295 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:21.674310 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60f05f58-60a5-4761-869b-a880b9318295 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:21.676048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60f05f58-60a5-4761-869b-a880b9318295 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:21.676685 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60f05f58-60a5-4761-869b-a880b9318295 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:21.677118 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60f05f58-60a5-4761-869b-a880b9318295 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:21.696554 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-24d48840-981d-4493-a2ff-d9576d792490 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:21.705322 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-24d48840-981d-4493-a2ff-d9576d792490 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.180343 Oct 27 17:31:21.705896 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 83/162] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:21 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:21.810794 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-60f05f58-60a5-4761-869b-a880b9318295 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:21.819567 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-60f05f58-60a5-4761-869b-a880b9318295 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:21.821221 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-60f05f58-60a5-4761-869b-a880b9318295 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:21.822387 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-60f05f58-60a5-4761-869b-a880b9318295 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.160341 Oct 27 17:31:21.823311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 80/163] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:21 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:31:21.864004 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b2fd63a7-229a-451d-9847-d264161e20d6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:21.864619 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b2fd63a7-229a-451d-9847-d264161e20d6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:21.867791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=100 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:31:21.871662 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2fd63a7-229a-451d-9847-d264161e20d6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:21.872174 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2fd63a7-229a-451d-9847-d264161e20d6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:21.872607 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2fd63a7-229a-451d-9847-d264161e20d6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:21.873297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2fd63a7-229a-451d-9847-d264161e20d6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:21.873750 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2fd63a7-229a-451d-9847-d264161e20d6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:21.874172 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2fd63a7-229a-451d-9847-d264161e20d6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:22.006780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-b2fd63a7-229a-451d-9847-d264161e20d6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:22.014429 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b2fd63a7-229a-451d-9847-d264161e20d6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.154789 Oct 27 17:31:22.015001 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 84/164] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:21 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:22.108099 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4cfd954f-8a79-4942-a544-8fbb160bcd58 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:22.108854 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4cfd954f-8a79-4942-a544-8fbb160bcd58 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:22.115264 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4cfd954f-8a79-4942-a544-8fbb160bcd58 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:22.115772 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4cfd954f-8a79-4942-a544-8fbb160bcd58 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:22.116209 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4cfd954f-8a79-4942-a544-8fbb160bcd58 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:22.116892 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4cfd954f-8a79-4942-a544-8fbb160bcd58 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:22.117340 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4cfd954f-8a79-4942-a544-8fbb160bcd58 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:22.117759 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4cfd954f-8a79-4942-a544-8fbb160bcd58 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:22.260305 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4cfd954f-8a79-4942-a544-8fbb160bcd58 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:22.267874 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4cfd954f-8a79-4942-a544-8fbb160bcd58 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.164090 Oct 27 17:31:22.268472 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 81/165] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:22 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:22.279869 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-3e104d9e-c4c1-4df9-91f0-313741f1d8a0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:22.280755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-3e104d9e-c4c1-4df9-91f0-313741f1d8a0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:22.286675 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3e104d9e-c4c1-4df9-91f0-313741f1d8a0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:22.287158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3e104d9e-c4c1-4df9-91f0-313741f1d8a0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:22.287593 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3e104d9e-c4c1-4df9-91f0-313741f1d8a0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:22.288318 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3e104d9e-c4c1-4df9-91f0-313741f1d8a0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:22.288774 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3e104d9e-c4c1-4df9-91f0-313741f1d8a0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:22.289194 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3e104d9e-c4c1-4df9-91f0-313741f1d8a0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:22.426901 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-3e104d9e-c4c1-4df9-91f0-313741f1d8a0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:22.435116 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-3e104d9e-c4c1-4df9-91f0-313741f1d8a0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.160189 Oct 27 17:31:22.435725 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 85/166] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:22 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:22.728177 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-402f5d5a-eefb-4f4b-b045-b88c59c0ec34 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:22.728789 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-402f5d5a-eefb-4f4b-b045-b88c59c0ec34 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:22.734947 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-402f5d5a-eefb-4f4b-b045-b88c59c0ec34 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:22.735427 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-402f5d5a-eefb-4f4b-b045-b88c59c0ec34 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:22.735891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-402f5d5a-eefb-4f4b-b045-b88c59c0ec34 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:22.736578 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-402f5d5a-eefb-4f4b-b045-b88c59c0ec34 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:22.737027 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-402f5d5a-eefb-4f4b-b045-b88c59c0ec34 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:22.737447 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-402f5d5a-eefb-4f4b-b045-b88c59c0ec34 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:22.849101 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6459fdc6-936c-47a3-ba77-abbb2f51d3e5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:22.850443 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-6459fdc6-936c-47a3-ba77-abbb2f51d3e5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:22.858112 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6459fdc6-936c-47a3-ba77-abbb2f51d3e5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:22.858910 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6459fdc6-936c-47a3-ba77-abbb2f51d3e5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:22.859540 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6459fdc6-936c-47a3-ba77-abbb2f51d3e5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:22.860521 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6459fdc6-936c-47a3-ba77-abbb2f51d3e5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:22.861181 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6459fdc6-936c-47a3-ba77-abbb2f51d3e5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:22.861793 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6459fdc6-936c-47a3-ba77-abbb2f51d3e5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:22.870331 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-402f5d5a-eefb-4f4b-b045-b88c59c0ec34 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:22.879236 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-402f5d5a-eefb-4f4b-b045-b88c59c0ec34 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.154852 Oct 27 17:31:22.880088 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 82/167] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:22 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:23.038072 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-da46e536-0c4b-4208-be9b-5181ce3c13d0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:23.039335 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-da46e536-0c4b-4208-be9b-5181ce3c13d0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:23.047804 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-da46e536-0c4b-4208-be9b-5181ce3c13d0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:23.048695 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-da46e536-0c4b-4208-be9b-5181ce3c13d0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:23.049239 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-da46e536-0c4b-4208-be9b-5181ce3c13d0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:23.049847 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-da46e536-0c4b-4208-be9b-5181ce3c13d0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:23.050296 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-da46e536-0c4b-4208-be9b-5181ce3c13d0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:23.051056 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-da46e536-0c4b-4208-be9b-5181ce3c13d0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:23.056292 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-6459fdc6-936c-47a3-ba77-abbb2f51d3e5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:23.070388 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-6459fdc6-936c-47a3-ba77-abbb2f51d3e5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:23.071934 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-6459fdc6-936c-47a3-ba77-abbb2f51d3e5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:23.077959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6459fdc6-936c-47a3-ba77-abbb2f51d3e5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.233668 Oct 27 17:31:23.078608 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 86/168] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:22 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:31:23.193326 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-da46e536-0c4b-4208-be9b-5181ce3c13d0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:23.201245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-da46e536-0c4b-4208-be9b-5181ce3c13d0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.168050 Oct 27 17:31:23.201832 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 83/169] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:23 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:23.290145 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-481eeb20-4bd9-4f99-a63e-7f22ec86a869 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:23.290752 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-481eeb20-4bd9-4f99-a63e-7f22ec86a869 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:23.296711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-481eeb20-4bd9-4f99-a63e-7f22ec86a869 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:23.297191 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-481eeb20-4bd9-4f99-a63e-7f22ec86a869 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:23.297624 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-481eeb20-4bd9-4f99-a63e-7f22ec86a869 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:23.298340 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-481eeb20-4bd9-4f99-a63e-7f22ec86a869 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:23.298792 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-481eeb20-4bd9-4f99-a63e-7f22ec86a869 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:23.299240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-481eeb20-4bd9-4f99-a63e-7f22ec86a869 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:23.435675 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-481eeb20-4bd9-4f99-a63e-7f22ec86a869 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:23.445062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-481eeb20-4bd9-4f99-a63e-7f22ec86a869 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.158729 Oct 27 17:31:23.445827 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 87/170] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:23 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:23.458363 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-263be2ee-ab0a-4e5c-bd5b-0685c859a750 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:23.458973 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-263be2ee-ab0a-4e5c-bd5b-0685c859a750 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:23.464909 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-263be2ee-ab0a-4e5c-bd5b-0685c859a750 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:23.465393 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-263be2ee-ab0a-4e5c-bd5b-0685c859a750 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:23.465825 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-263be2ee-ab0a-4e5c-bd5b-0685c859a750 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:23.466512 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-263be2ee-ab0a-4e5c-bd5b-0685c859a750 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:23.466963 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-263be2ee-ab0a-4e5c-bd5b-0685c859a750 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:23.467387 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-263be2ee-ab0a-4e5c-bd5b-0685c859a750 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:23.614708 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-263be2ee-ab0a-4e5c-bd5b-0685c859a750 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:23.622374 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-263be2ee-ab0a-4e5c-bd5b-0685c859a750 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.167856 Oct 27 17:31:23.622946 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 84/171] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:23 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:23.902378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a2ceccfd-cbed-4516-b61d-30c46bf76760 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:23.903097 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a2ceccfd-cbed-4516-b61d-30c46bf76760 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:23.908994 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a2ceccfd-cbed-4516-b61d-30c46bf76760 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:23.909482 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a2ceccfd-cbed-4516-b61d-30c46bf76760 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:23.909915 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a2ceccfd-cbed-4516-b61d-30c46bf76760 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:23.910602 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a2ceccfd-cbed-4516-b61d-30c46bf76760 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:23.911053 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a2ceccfd-cbed-4516-b61d-30c46bf76760 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:23.911465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a2ceccfd-cbed-4516-b61d-30c46bf76760 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:24.048362 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a2ceccfd-cbed-4516-b61d-30c46bf76760 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:24.057661 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a2ceccfd-cbed-4516-b61d-30c46bf76760 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.159127 Oct 27 17:31:24.058300 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 88/172] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:23 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:24.111117 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-5a78c316-52fe-4a42-a8f5-047a54642174 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:24.113088 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-5a78c316-52fe-4a42-a8f5-047a54642174 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:24.120048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a78c316-52fe-4a42-a8f5-047a54642174 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:24.120523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a78c316-52fe-4a42-a8f5-047a54642174 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:24.120946 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a78c316-52fe-4a42-a8f5-047a54642174 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:24.121627 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a78c316-52fe-4a42-a8f5-047a54642174 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:24.122105 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a78c316-52fe-4a42-a8f5-047a54642174 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:24.122514 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a78c316-52fe-4a42-a8f5-047a54642174 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:24.224483 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-58a9796e-dc10-4927-8db2-72b9a2cfcbab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:24.225093 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-58a9796e-dc10-4927-8db2-72b9a2cfcbab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:24.230960 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-58a9796e-dc10-4927-8db2-72b9a2cfcbab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:24.231436 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-58a9796e-dc10-4927-8db2-72b9a2cfcbab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:24.232159 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-58a9796e-dc10-4927-8db2-72b9a2cfcbab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:24.232845 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-58a9796e-dc10-4927-8db2-72b9a2cfcbab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:24.233295 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-58a9796e-dc10-4927-8db2-72b9a2cfcbab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:24.233711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-58a9796e-dc10-4927-8db2-72b9a2cfcbab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:24.254802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5a78c316-52fe-4a42-a8f5-047a54642174 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:24.263075 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5a78c316-52fe-4a42-a8f5-047a54642174 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:24.264536 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5a78c316-52fe-4a42-a8f5-047a54642174 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:24.265626 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-5a78c316-52fe-4a42-a8f5-047a54642174 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.165972 Oct 27 17:31:24.266390 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 85/173] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:24 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:24.361593 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-58a9796e-dc10-4927-8db2-72b9a2cfcbab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:24.369718 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-58a9796e-dc10-4927-8db2-72b9a2cfcbab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.149642 Oct 27 17:31:24.370283 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 89/174] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:24 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:24.467500 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d9a5e76b-13a3-4977-b9c7-8cebc8cf0e52 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:24.468123 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d9a5e76b-13a3-4977-b9c7-8cebc8cf0e52 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:24.474577 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d9a5e76b-13a3-4977-b9c7-8cebc8cf0e52 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:24.475051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d9a5e76b-13a3-4977-b9c7-8cebc8cf0e52 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:24.475476 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d9a5e76b-13a3-4977-b9c7-8cebc8cf0e52 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:24.476176 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d9a5e76b-13a3-4977-b9c7-8cebc8cf0e52 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:24.476626 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d9a5e76b-13a3-4977-b9c7-8cebc8cf0e52 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:24.477037 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d9a5e76b-13a3-4977-b9c7-8cebc8cf0e52 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:24.604124 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d9a5e76b-13a3-4977-b9c7-8cebc8cf0e52 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:24.612245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d9a5e76b-13a3-4977-b9c7-8cebc8cf0e52 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.148385 Oct 27 17:31:24.612806 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 86/175] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:24 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:24.645234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-04c05a2e-ee53-41ef-8635-502817ad9066 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:24.645836 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-04c05a2e-ee53-41ef-8635-502817ad9066 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:24.652161 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04c05a2e-ee53-41ef-8635-502817ad9066 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:24.652633 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04c05a2e-ee53-41ef-8635-502817ad9066 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:24.653059 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04c05a2e-ee53-41ef-8635-502817ad9066 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:24.653734 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04c05a2e-ee53-41ef-8635-502817ad9066 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:24.654181 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04c05a2e-ee53-41ef-8635-502817ad9066 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:24.654591 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-04c05a2e-ee53-41ef-8635-502817ad9066 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:24.658520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=100 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:31:24.781230 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-04c05a2e-ee53-41ef-8635-502817ad9066 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:24.789335 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-04c05a2e-ee53-41ef-8635-502817ad9066 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.148383 Oct 27 17:31:24.789900 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 90/176] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:24 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:25.080493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-10da52e0-856a-45e4-9350-a42752222124 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:25.081757 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-10da52e0-856a-45e4-9350-a42752222124 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:25.087685 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10da52e0-856a-45e4-9350-a42752222124 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:25.088201 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10da52e0-856a-45e4-9350-a42752222124 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:25.088670 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10da52e0-856a-45e4-9350-a42752222124 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:25.089354 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10da52e0-856a-45e4-9350-a42752222124 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:25.089809 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10da52e0-856a-45e4-9350-a42752222124 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:25.090232 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10da52e0-856a-45e4-9350-a42752222124 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:25.109144 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=100 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:31:25.218158 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-10da52e0-856a-45e4-9350-a42752222124 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:25.226377 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-10da52e0-856a-45e4-9350-a42752222124 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.149736 Oct 27 17:31:25.226970 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 87/177] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:25 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:25.290506 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-42c94d65-9e8c-4824-b09d-164e261dff1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:25.291115 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-42c94d65-9e8c-4824-b09d-164e261dff1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:25.297058 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-42c94d65-9e8c-4824-b09d-164e261dff1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:25.297549 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-42c94d65-9e8c-4824-b09d-164e261dff1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:25.297985 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-42c94d65-9e8c-4824-b09d-164e261dff1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:25.298668 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-42c94d65-9e8c-4824-b09d-164e261dff1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:25.299124 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-42c94d65-9e8c-4824-b09d-164e261dff1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:25.299549 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-42c94d65-9e8c-4824-b09d-164e261dff1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:25.392027 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-590ab44e-7b58-47e5-b226-0762ccd1a139 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:25.392849 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-590ab44e-7b58-47e5-b226-0762ccd1a139 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:25.399191 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-590ab44e-7b58-47e5-b226-0762ccd1a139 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:25.399667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-590ab44e-7b58-47e5-b226-0762ccd1a139 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:25.400356 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-590ab44e-7b58-47e5-b226-0762ccd1a139 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:25.400965 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-590ab44e-7b58-47e5-b226-0762ccd1a139 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:25.401409 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-590ab44e-7b58-47e5-b226-0762ccd1a139 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:25.401854 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-590ab44e-7b58-47e5-b226-0762ccd1a139 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:25.425272 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-42c94d65-9e8c-4824-b09d-164e261dff1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:25.433357 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-42c94d65-9e8c-4824-b09d-164e261dff1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:25.434796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-42c94d65-9e8c-4824-b09d-164e261dff1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:25.435915 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-42c94d65-9e8c-4824-b09d-164e261dff1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.149290 Oct 27 17:31:25.436476 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 91/178] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:25 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:25.530378 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-590ab44e-7b58-47e5-b226-0762ccd1a139 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:25.538533 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-590ab44e-7b58-47e5-b226-0762ccd1a139 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.150275 Oct 27 17:31:25.539104 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 88/179] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:25 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:25.634619 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-36eefe55-e9f7-4473-8a18-d8cd0af942f6 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:25.635233 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-36eefe55-e9f7-4473-8a18-d8cd0af942f6 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:25.641326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-36eefe55-e9f7-4473-8a18-d8cd0af942f6 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:25.641812 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-36eefe55-e9f7-4473-8a18-d8cd0af942f6 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:25.642342 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-36eefe55-e9f7-4473-8a18-d8cd0af942f6 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:25.643035 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-36eefe55-e9f7-4473-8a18-d8cd0af942f6 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:25.644140 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-36eefe55-e9f7-4473-8a18-d8cd0af942f6 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:25.644569 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-36eefe55-e9f7-4473-8a18-d8cd0af942f6 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:25.772694 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-36eefe55-e9f7-4473-8a18-d8cd0af942f6 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:25.780477 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-36eefe55-e9f7-4473-8a18-d8cd0af942f6 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.149594 Oct 27 17:31:25.781039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 92/180] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:25 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:25.813630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-956ad811-ecb9-41f5-baa9-92feea09cd80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:25.814468 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-956ad811-ecb9-41f5-baa9-92feea09cd80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:25.821370 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-956ad811-ecb9-41f5-baa9-92feea09cd80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:25.821858 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-956ad811-ecb9-41f5-baa9-92feea09cd80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:25.822291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-956ad811-ecb9-41f5-baa9-92feea09cd80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:25.822980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-956ad811-ecb9-41f5-baa9-92feea09cd80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:25.823429 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-956ad811-ecb9-41f5-baa9-92feea09cd80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:25.823886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-956ad811-ecb9-41f5-baa9-92feea09cd80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:25.959472 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-956ad811-ecb9-41f5-baa9-92feea09cd80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:25.967608 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-956ad811-ecb9-41f5-baa9-92feea09cd80 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.158534 Oct 27 17:31:25.968214 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 89/181] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:25 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:25.988179 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-6b03a047-644e-44aa-bd47-e5971c006725 req-61e92860-dc16-45c0-82fb-051ec0bdb2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13686e3e-dfd4-4f2e-9781-92321ff85702", "name": "network-vif-plugged", "status": "completed", "tag": "021b0623-ac50-4080-925e-8bf3d47884b1"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:31:25.998827 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-6b03a047-644e-44aa-bd47-e5971c006725 req-61e92860-dc16-45c0-82fb-051ec0bdb2c6 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:25.999213 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-6b03a047-644e-44aa-bd47-e5971c006725 req-61e92860-dc16-45c0-82fb-051ec0bdb2c6 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:25.999646 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-6b03a047-644e-44aa-bd47-e5971c006725 req-61e92860-dc16-45c0-82fb-051ec0bdb2c6 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:26.011311 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-6b03a047-644e-44aa-bd47-e5971c006725 req-61e92860-dc16-45c0-82fb-051ec0bdb2c6 service nova] Creating event network-vif-plugged:021b0623-ac50-4080-925e-8bf3d47884b1 for instance 13686e3e-dfd4-4f2e-9781-92321ff85702 on hv-cinder-86283 Oct 27 17:31:26.016302 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-6b03a047-644e-44aa-bd47-e5971c006725 req-61e92860-dc16-45c0-82fb-051ec0bdb2c6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033082 Oct 27 17:31:26.016894 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 93/182] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:31:26.248830 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f8af756b-493c-452f-996e-b29127f6ee2a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:26.249439 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-f8af756b-493c-452f-996e-b29127f6ee2a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:26.256383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8af756b-493c-452f-996e-b29127f6ee2a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:26.256907 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8af756b-493c-452f-996e-b29127f6ee2a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:26.257342 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8af756b-493c-452f-996e-b29127f6ee2a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:26.258196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8af756b-493c-452f-996e-b29127f6ee2a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:26.258652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8af756b-493c-452f-996e-b29127f6ee2a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:26.259159 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8af756b-493c-452f-996e-b29127f6ee2a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:26.397705 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f8af756b-493c-452f-996e-b29127f6ee2a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:26.406087 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f8af756b-493c-452f-996e-b29127f6ee2a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.160931 Oct 27 17:31:26.406627 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 90/183] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:26 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:26.461763 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-477f5de9-5c06-4c4f-8a12-4a8baafddb35 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:26.462457 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-477f5de9-5c06-4c4f-8a12-4a8baafddb35 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:26.468500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-477f5de9-5c06-4c4f-8a12-4a8baafddb35 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:26.468979 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-477f5de9-5c06-4c4f-8a12-4a8baafddb35 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:26.469410 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-477f5de9-5c06-4c4f-8a12-4a8baafddb35 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:26.470088 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-477f5de9-5c06-4c4f-8a12-4a8baafddb35 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:26.470535 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-477f5de9-5c06-4c4f-8a12-4a8baafddb35 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:26.470950 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-477f5de9-5c06-4c4f-8a12-4a8baafddb35 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:26.560708 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-1500328b-247b-4558-9774-eedd03484bb3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:26.561323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-1500328b-247b-4558-9774-eedd03484bb3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:26.567734 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1500328b-247b-4558-9774-eedd03484bb3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:26.568246 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1500328b-247b-4558-9774-eedd03484bb3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:26.568680 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1500328b-247b-4558-9774-eedd03484bb3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:26.569366 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1500328b-247b-4558-9774-eedd03484bb3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:26.569814 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1500328b-247b-4558-9774-eedd03484bb3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:26.570231 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1500328b-247b-4558-9774-eedd03484bb3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:26.600070 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-477f5de9-5c06-4c4f-8a12-4a8baafddb35 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:26.608560 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-477f5de9-5c06-4c4f-8a12-4a8baafddb35 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:26.610040 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-477f5de9-5c06-4c4f-8a12-4a8baafddb35 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:26.611175 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-477f5de9-5c06-4c4f-8a12-4a8baafddb35 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.153723 Oct 27 17:31:26.611750 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 94/184] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:26 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:26.697731 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1500328b-247b-4558-9774-eedd03484bb3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:26.705689 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-1500328b-247b-4558-9774-eedd03484bb3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.148720 Oct 27 17:31:26.706256 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 91/185] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:26 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:26.803656 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-09b6460d-9903-44ad-a88c-8dea4a7b4c2c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:26.804297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-09b6460d-9903-44ad-a88c-8dea4a7b4c2c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:26.810183 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09b6460d-9903-44ad-a88c-8dea4a7b4c2c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:26.810663 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09b6460d-9903-44ad-a88c-8dea4a7b4c2c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:26.811098 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09b6460d-9903-44ad-a88c-8dea4a7b4c2c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:26.811821 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09b6460d-9903-44ad-a88c-8dea4a7b4c2c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:26.812273 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09b6460d-9903-44ad-a88c-8dea4a7b4c2c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:26.812688 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09b6460d-9903-44ad-a88c-8dea4a7b4c2c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:26.952316 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-09b6460d-9903-44ad-a88c-8dea4a7b4c2c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:26.962055 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-09b6460d-9903-44ad-a88c-8dea4a7b4c2c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.162600 Oct 27 17:31:26.963878 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 95/186] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:26 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:26.991290 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6908d293-37cb-460e-97a5-8b24b0f566d4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:26.991936 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6908d293-37cb-460e-97a5-8b24b0f566d4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:26.997821 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6908d293-37cb-460e-97a5-8b24b0f566d4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:26.998402 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6908d293-37cb-460e-97a5-8b24b0f566d4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:26.998920 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6908d293-37cb-460e-97a5-8b24b0f566d4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:26.999645 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6908d293-37cb-460e-97a5-8b24b0f566d4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:27.000237 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6908d293-37cb-460e-97a5-8b24b0f566d4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:27.000697 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6908d293-37cb-460e-97a5-8b24b0f566d4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:27.126611 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-6908d293-37cb-460e-97a5-8b24b0f566d4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:27.134833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6908d293-37cb-460e-97a5-8b24b0f566d4 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.147925 Oct 27 17:31:27.135393 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 92/187] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:26 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:27.429311 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-96c3e5cc-940d-4e8a-b00d-6ab0e109214f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:27.429923 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-96c3e5cc-940d-4e8a-b00d-6ab0e109214f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:27.435912 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-96c3e5cc-940d-4e8a-b00d-6ab0e109214f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:27.436337 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-96c3e5cc-940d-4e8a-b00d-6ab0e109214f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:27.436767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-96c3e5cc-940d-4e8a-b00d-6ab0e109214f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:27.437446 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-96c3e5cc-940d-4e8a-b00d-6ab0e109214f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:27.437892 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-96c3e5cc-940d-4e8a-b00d-6ab0e109214f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:27.438311 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-96c3e5cc-940d-4e8a-b00d-6ab0e109214f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:27.562148 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-96c3e5cc-940d-4e8a-b00d-6ab0e109214f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:27.569716 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-96c3e5cc-940d-4e8a-b00d-6ab0e109214f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.144814 Oct 27 17:31:27.570273 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 96/188] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:27 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:27.636360 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f5e009e5-29b4-44ac-85da-122964baca23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:27.637045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-f5e009e5-29b4-44ac-85da-122964baca23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:27.643797 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f5e009e5-29b4-44ac-85da-122964baca23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:27.644274 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f5e009e5-29b4-44ac-85da-122964baca23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:27.644696 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f5e009e5-29b4-44ac-85da-122964baca23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:27.645524 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f5e009e5-29b4-44ac-85da-122964baca23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:27.645966 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f5e009e5-29b4-44ac-85da-122964baca23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:27.646382 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f5e009e5-29b4-44ac-85da-122964baca23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:27.728078 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-005ef973-43c5-48a4-bd32-dcb88ae5eef4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:27.728712 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-005ef973-43c5-48a4-bd32-dcb88ae5eef4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:27.734910 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-005ef973-43c5-48a4-bd32-dcb88ae5eef4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:27.735381 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-005ef973-43c5-48a4-bd32-dcb88ae5eef4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:27.735842 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-005ef973-43c5-48a4-bd32-dcb88ae5eef4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:27.736520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-005ef973-43c5-48a4-bd32-dcb88ae5eef4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:27.736968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-005ef973-43c5-48a4-bd32-dcb88ae5eef4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:27.737394 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-005ef973-43c5-48a4-bd32-dcb88ae5eef4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:27.777773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f5e009e5-29b4-44ac-85da-122964baca23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:27.786460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f5e009e5-29b4-44ac-85da-122964baca23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:27.787920 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f5e009e5-29b4-44ac-85da-122964baca23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:27.789009 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f5e009e5-29b4-44ac-85da-122964baca23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.156630 Oct 27 17:31:27.789569 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 93/189] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:27 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:27.866855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-005ef973-43c5-48a4-bd32-dcb88ae5eef4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:27.874484 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-005ef973-43c5-48a4-bd32-dcb88ae5eef4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.150212 Oct 27 17:31:27.875049 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 97/190] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:27 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:27.985087 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e7c52258-4adb-41c7-a682-3d039520685b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:27.985692 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e7c52258-4adb-41c7-a682-3d039520685b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:27.991555 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e7c52258-4adb-41c7-a682-3d039520685b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:27.992056 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e7c52258-4adb-41c7-a682-3d039520685b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:27.992481 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e7c52258-4adb-41c7-a682-3d039520685b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:27.993154 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e7c52258-4adb-41c7-a682-3d039520685b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:27.993598 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e7c52258-4adb-41c7-a682-3d039520685b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:27.994008 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e7c52258-4adb-41c7-a682-3d039520685b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:28.121152 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e7c52258-4adb-41c7-a682-3d039520685b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:28.129256 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e7c52258-4adb-41c7-a682-3d039520685b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.148285 Oct 27 17:31:28.129820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 94/191] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:27 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:28.157847 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-09f10f14-3eb7-457f-8eec-5b2fb443a9e0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:28.158551 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-09f10f14-3eb7-457f-8eec-5b2fb443a9e0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:28.165064 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09f10f14-3eb7-457f-8eec-5b2fb443a9e0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:28.165544 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09f10f14-3eb7-457f-8eec-5b2fb443a9e0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:28.165973 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09f10f14-3eb7-457f-8eec-5b2fb443a9e0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:28.166656 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09f10f14-3eb7-457f-8eec-5b2fb443a9e0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:28.167105 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09f10f14-3eb7-457f-8eec-5b2fb443a9e0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:28.167535 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09f10f14-3eb7-457f-8eec-5b2fb443a9e0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:28.296187 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-09f10f14-3eb7-457f-8eec-5b2fb443a9e0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:28.304246 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-09f10f14-3eb7-457f-8eec-5b2fb443a9e0 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.150251 Oct 27 17:31:28.304889 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 98/192] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:28 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:28.593115 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-24ce21ab-3d69-49d6-945a-551029096dc9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:28.593723 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-24ce21ab-3d69-49d6-945a-551029096dc9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:28.600159 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-24ce21ab-3d69-49d6-945a-551029096dc9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:28.600636 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-24ce21ab-3d69-49d6-945a-551029096dc9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:28.601072 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-24ce21ab-3d69-49d6-945a-551029096dc9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:28.601748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-24ce21ab-3d69-49d6-945a-551029096dc9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:28.602195 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-24ce21ab-3d69-49d6-945a-551029096dc9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:28.602612 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-24ce21ab-3d69-49d6-945a-551029096dc9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:28.729858 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-24ce21ab-3d69-49d6-945a-551029096dc9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:28.738130 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-24ce21ab-3d69-49d6-945a-551029096dc9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.148871 Oct 27 17:31:28.738695 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 95/193] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:28 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:28.813578 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-bee25d32-0876-4929-9ed1-50d34b0fdf4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:28.814172 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-bee25d32-0876-4929-9ed1-50d34b0fdf4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:28.820224 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bee25d32-0876-4929-9ed1-50d34b0fdf4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:28.820696 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bee25d32-0876-4929-9ed1-50d34b0fdf4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:28.821119 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bee25d32-0876-4929-9ed1-50d34b0fdf4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:28.821787 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bee25d32-0876-4929-9ed1-50d34b0fdf4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:28.822228 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bee25d32-0876-4929-9ed1-50d34b0fdf4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:28.822641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bee25d32-0876-4929-9ed1-50d34b0fdf4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:28.897937 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-10cd5c42-1b2d-441d-a53b-37703f836843 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:28.898495 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-10cd5c42-1b2d-441d-a53b-37703f836843 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:28.904352 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10cd5c42-1b2d-441d-a53b-37703f836843 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:28.904834 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10cd5c42-1b2d-441d-a53b-37703f836843 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:28.905265 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10cd5c42-1b2d-441d-a53b-37703f836843 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:28.905948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10cd5c42-1b2d-441d-a53b-37703f836843 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:28.906393 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10cd5c42-1b2d-441d-a53b-37703f836843 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:28.906809 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10cd5c42-1b2d-441d-a53b-37703f836843 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:28.947239 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-bee25d32-0876-4929-9ed1-50d34b0fdf4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:28.955275 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-bee25d32-0876-4929-9ed1-50d34b0fdf4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:28.957242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-bee25d32-0876-4929-9ed1-50d34b0fdf4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:28.958327 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-bee25d32-0876-4929-9ed1-50d34b0fdf4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.148634 Oct 27 17:31:28.959062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 99/194] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:28 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:29.033369 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-10cd5c42-1b2d-441d-a53b-37703f836843 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:29.041412 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-10cd5c42-1b2d-441d-a53b-37703f836843 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.147471 Oct 27 17:31:29.041972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 96/195] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:28 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:29.152229 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-7e310c9f-f2c3-46e3-8345-97801287b8da tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:29.152772 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-7e310c9f-f2c3-46e3-8345-97801287b8da tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:29.158621 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7e310c9f-f2c3-46e3-8345-97801287b8da tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:29.159909 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7e310c9f-f2c3-46e3-8345-97801287b8da tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:29.160342 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7e310c9f-f2c3-46e3-8345-97801287b8da tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:29.161048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7e310c9f-f2c3-46e3-8345-97801287b8da tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:29.161492 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7e310c9f-f2c3-46e3-8345-97801287b8da tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:29.161935 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7e310c9f-f2c3-46e3-8345-97801287b8da tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:29.289941 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7e310c9f-f2c3-46e3-8345-97801287b8da tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:29.297596 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-7e310c9f-f2c3-46e3-8345-97801287b8da tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.149194 Oct 27 17:31:29.298150 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 100/196] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:29 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:29.328272 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-765b3a0f-a03d-4c20-8e35-09de6a041d88 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:29.328894 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-765b3a0f-a03d-4c20-8e35-09de6a041d88 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:29.334833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-765b3a0f-a03d-4c20-8e35-09de6a041d88 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:29.335315 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-765b3a0f-a03d-4c20-8e35-09de6a041d88 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:29.335769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-765b3a0f-a03d-4c20-8e35-09de6a041d88 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:29.336455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-765b3a0f-a03d-4c20-8e35-09de6a041d88 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:29.336903 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-765b3a0f-a03d-4c20-8e35-09de6a041d88 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:29.337321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-765b3a0f-a03d-4c20-8e35-09de6a041d88 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:29.464764 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-765b3a0f-a03d-4c20-8e35-09de6a041d88 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:29.473651 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-765b3a0f-a03d-4c20-8e35-09de6a041d88 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.149023 Oct 27 17:31:29.474430 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 97/197] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:29 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:29.760715 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-50c50cb5-1b2f-42cd-be23-811f3a533a88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:29.761268 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-50c50cb5-1b2f-42cd-be23-811f3a533a88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:29.767399 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-50c50cb5-1b2f-42cd-be23-811f3a533a88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:29.767918 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-50c50cb5-1b2f-42cd-be23-811f3a533a88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:29.768424 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-50c50cb5-1b2f-42cd-be23-811f3a533a88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:29.769075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-50c50cb5-1b2f-42cd-be23-811f3a533a88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:29.769527 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-50c50cb5-1b2f-42cd-be23-811f3a533a88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:29.769948 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-50c50cb5-1b2f-42cd-be23-811f3a533a88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:29.901279 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-50c50cb5-1b2f-42cd-be23-811f3a533a88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:29.908985 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-50c50cb5-1b2f-42cd-be23-811f3a533a88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.152153 Oct 27 17:31:29.909546 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 101/198] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:29 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:29.983790 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e0fd694f-e066-41d0-bfd4-8788a602e226 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:29.984456 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e0fd694f-e066-41d0-bfd4-8788a602e226 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:29.990946 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e0fd694f-e066-41d0-bfd4-8788a602e226 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:29.991425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e0fd694f-e066-41d0-bfd4-8788a602e226 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:29.991893 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e0fd694f-e066-41d0-bfd4-8788a602e226 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:29.992611 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e0fd694f-e066-41d0-bfd4-8788a602e226 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:29.993058 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e0fd694f-e066-41d0-bfd4-8788a602e226 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:29.993476 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e0fd694f-e066-41d0-bfd4-8788a602e226 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:30.063998 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4fdb917d-8147-4424-a55a-91c74500105d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:30.064524 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4fdb917d-8147-4424-a55a-91c74500105d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:30.070510 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fdb917d-8147-4424-a55a-91c74500105d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:30.070995 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fdb917d-8147-4424-a55a-91c74500105d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:30.071432 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fdb917d-8147-4424-a55a-91c74500105d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:30.072166 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fdb917d-8147-4424-a55a-91c74500105d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:30.072619 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fdb917d-8147-4424-a55a-91c74500105d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:30.073039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fdb917d-8147-4424-a55a-91c74500105d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:30.127468 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e0fd694f-e066-41d0-bfd4-8788a602e226 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:30.136174 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e0fd694f-e066-41d0-bfd4-8788a602e226 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:30.137608 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e0fd694f-e066-41d0-bfd4-8788a602e226 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:30.138703 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e0fd694f-e066-41d0-bfd4-8788a602e226 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.159185 Oct 27 17:31:30.139360 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 98/199] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:29 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:30.200422 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4fdb917d-8147-4424-a55a-91c74500105d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:30.208648 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4fdb917d-8147-4424-a55a-91c74500105d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.148687 Oct 27 17:31:30.209214 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 102/200] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:30 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:30.320776 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d0b58bad-dd5e-4dab-8393-17a1056f1cac tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:30.321327 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d0b58bad-dd5e-4dab-8393-17a1056f1cac tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:30.327231 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d0b58bad-dd5e-4dab-8393-17a1056f1cac tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:30.327724 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d0b58bad-dd5e-4dab-8393-17a1056f1cac tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:30.328173 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d0b58bad-dd5e-4dab-8393-17a1056f1cac tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:30.328853 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d0b58bad-dd5e-4dab-8393-17a1056f1cac tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:30.329304 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d0b58bad-dd5e-4dab-8393-17a1056f1cac tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:30.329721 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d0b58bad-dd5e-4dab-8393-17a1056f1cac tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:30.453812 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d0b58bad-dd5e-4dab-8393-17a1056f1cac tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:30.461440 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d0b58bad-dd5e-4dab-8393-17a1056f1cac tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.144553 Oct 27 17:31:30.462022 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 99/201] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:30 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:30.497862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f3006ac0-d836-4a2d-ab83-3668aa945c5b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:30.498547 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f3006ac0-d836-4a2d-ab83-3668aa945c5b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:30.505393 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f3006ac0-d836-4a2d-ab83-3668aa945c5b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:30.505944 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f3006ac0-d836-4a2d-ab83-3668aa945c5b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:30.506380 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f3006ac0-d836-4a2d-ab83-3668aa945c5b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:30.507213 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f3006ac0-d836-4a2d-ab83-3668aa945c5b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:30.507670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f3006ac0-d836-4a2d-ab83-3668aa945c5b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:30.508115 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f3006ac0-d836-4a2d-ab83-3668aa945c5b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:30.691878 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f3006ac0-d836-4a2d-ab83-3668aa945c5b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:30.699550 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f3006ac0-d836-4a2d-ab83-3668aa945c5b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1314 microversion: 2.1 time: 0.205761 Oct 27 17:31:30.700136 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 103/202] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:30 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:30.930974 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b254cd3b-e095-4780-9c2d-9b05ac542241 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:30.931607 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b254cd3b-e095-4780-9c2d-9b05ac542241 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:30.937630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b254cd3b-e095-4780-9c2d-9b05ac542241 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:30.938115 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b254cd3b-e095-4780-9c2d-9b05ac542241 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:30.938541 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b254cd3b-e095-4780-9c2d-9b05ac542241 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:30.939225 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b254cd3b-e095-4780-9c2d-9b05ac542241 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:30.939678 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b254cd3b-e095-4780-9c2d-9b05ac542241 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:30.940127 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b254cd3b-e095-4780-9c2d-9b05ac542241 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:31.068517 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b254cd3b-e095-4780-9c2d-9b05ac542241 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:31.076175 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b254cd3b-e095-4780-9c2d-9b05ac542241 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.149029 Oct 27 17:31:31.076749 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 100/203] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:30 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:31.164684 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ef60dc90-c8a2-4bba-bcf8-06aef738921a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:31.165364 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-ef60dc90-c8a2-4bba-bcf8-06aef738921a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:31.171311 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ef60dc90-c8a2-4bba-bcf8-06aef738921a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:31.171928 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ef60dc90-c8a2-4bba-bcf8-06aef738921a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:31.172427 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ef60dc90-c8a2-4bba-bcf8-06aef738921a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:31.173350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ef60dc90-c8a2-4bba-bcf8-06aef738921a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:31.173620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ef60dc90-c8a2-4bba-bcf8-06aef738921a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:31.174327 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ef60dc90-c8a2-4bba-bcf8-06aef738921a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:31.231492 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a86f8793-66fc-445c-bb79-81dc63c28ba5 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:31.232516 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a86f8793-66fc-445c-bb79-81dc63c28ba5 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:31.238463 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a86f8793-66fc-445c-bb79-81dc63c28ba5 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:31.239010 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a86f8793-66fc-445c-bb79-81dc63c28ba5 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:31.239435 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a86f8793-66fc-445c-bb79-81dc63c28ba5 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:31.240159 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a86f8793-66fc-445c-bb79-81dc63c28ba5 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:31.240586 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a86f8793-66fc-445c-bb79-81dc63c28ba5 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:31.240996 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a86f8793-66fc-445c-bb79-81dc63c28ba5 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:31.305096 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ef60dc90-c8a2-4bba-bcf8-06aef738921a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:31.315384 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ef60dc90-c8a2-4bba-bcf8-06aef738921a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:31.316950 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ef60dc90-c8a2-4bba-bcf8-06aef738921a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:31.318228 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-ef60dc90-c8a2-4bba-bcf8-06aef738921a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.157405 Oct 27 17:31:31.319019 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 104/204] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:31 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:31.376410 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a86f8793-66fc-445c-bb79-81dc63c28ba5 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:31.384174 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a86f8793-66fc-445c-bb79-81dc63c28ba5 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.156568 Oct 27 17:31:31.384739 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 101/205] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:31 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:31.484418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-3c5e37bd-de63-4e8d-b626-293dad06b280 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:31.485096 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-3c5e37bd-de63-4e8d-b626-293dad06b280 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:31.491412 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c5e37bd-de63-4e8d-b626-293dad06b280 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:31.491997 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c5e37bd-de63-4e8d-b626-293dad06b280 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:31.492495 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c5e37bd-de63-4e8d-b626-293dad06b280 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:31.493242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c5e37bd-de63-4e8d-b626-293dad06b280 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:31.493760 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c5e37bd-de63-4e8d-b626-293dad06b280 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:31.494182 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c5e37bd-de63-4e8d-b626-293dad06b280 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:31.626064 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-3c5e37bd-de63-4e8d-b626-293dad06b280 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:31.634197 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-3c5e37bd-de63-4e8d-b626-293dad06b280 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.154111 Oct 27 17:31:31.634803 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 105/206] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:31 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:31.724242 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2596284d-223c-448d-8a33-6e531b2395f6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:31.724840 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2596284d-223c-448d-8a33-6e531b2395f6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:31.730751 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2596284d-223c-448d-8a33-6e531b2395f6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:31.731232 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2596284d-223c-448d-8a33-6e531b2395f6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:31.731948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2596284d-223c-448d-8a33-6e531b2395f6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:31.732625 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2596284d-223c-448d-8a33-6e531b2395f6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:31.733067 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2596284d-223c-448d-8a33-6e531b2395f6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:31.733480 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2596284d-223c-448d-8a33-6e531b2395f6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:31.858596 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2596284d-223c-448d-8a33-6e531b2395f6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:31.866804 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2596284d-223c-448d-8a33-6e531b2395f6 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1501 microversion: 2.1 time: 0.147135 Oct 27 17:31:31.867372 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 102/207] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:31 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1501 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:32.098776 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b2edd982-11fd-498d-9374-f5027e64b3f6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:32.099394 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b2edd982-11fd-498d-9374-f5027e64b3f6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:32.115735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2edd982-11fd-498d-9374-f5027e64b3f6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:32.115735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2edd982-11fd-498d-9374-f5027e64b3f6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:32.115735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2edd982-11fd-498d-9374-f5027e64b3f6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:32.115735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2edd982-11fd-498d-9374-f5027e64b3f6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:32.116262 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2edd982-11fd-498d-9374-f5027e64b3f6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:32.116262 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2edd982-11fd-498d-9374-f5027e64b3f6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:32.247847 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-b2edd982-11fd-498d-9374-f5027e64b3f6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:32.256343 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b2edd982-11fd-498d-9374-f5027e64b3f6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.161457 Oct 27 17:31:32.256905 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 106/208] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:32 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:32.343791 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-304cb13e-1a50-4561-a54a-fc6e34620998 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:32.344397 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-304cb13e-1a50-4561-a54a-fc6e34620998 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:32.351089 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-304cb13e-1a50-4561-a54a-fc6e34620998 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:32.351570 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-304cb13e-1a50-4561-a54a-fc6e34620998 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:32.352027 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-304cb13e-1a50-4561-a54a-fc6e34620998 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:32.352707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-304cb13e-1a50-4561-a54a-fc6e34620998 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:32.353180 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-304cb13e-1a50-4561-a54a-fc6e34620998 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:32.353601 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-304cb13e-1a50-4561-a54a-fc6e34620998 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:32.406456 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d38d044f-e7cc-4f59-a8b0-4767aeef7360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:32.407087 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d38d044f-e7cc-4f59-a8b0-4767aeef7360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:32.413212 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d38d044f-e7cc-4f59-a8b0-4767aeef7360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:32.413766 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d38d044f-e7cc-4f59-a8b0-4767aeef7360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:32.414291 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d38d044f-e7cc-4f59-a8b0-4767aeef7360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:32.415046 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d38d044f-e7cc-4f59-a8b0-4767aeef7360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:32.415563 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d38d044f-e7cc-4f59-a8b0-4767aeef7360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:32.416071 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d38d044f-e7cc-4f59-a8b0-4767aeef7360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:32.434128 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=100 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:31:32.486054 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-304cb13e-1a50-4561-a54a-fc6e34620998 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:32.494587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-304cb13e-1a50-4561-a54a-fc6e34620998 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:32.496062 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-304cb13e-1a50-4561-a54a-fc6e34620998 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:32.497179 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-304cb13e-1a50-4561-a54a-fc6e34620998 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.157265 Oct 27 17:31:32.497738 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 103/209] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:32 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:32.546494 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d38d044f-e7cc-4f59-a8b0-4767aeef7360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:32.554863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d38d044f-e7cc-4f59-a8b0-4767aeef7360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.152250 Oct 27 17:31:32.555578 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 107/210] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:32 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:32.657481 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-94830f8f-0417-4b8d-9d52-b5ff8c9ba533 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:32.658030 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-94830f8f-0417-4b8d-9d52-b5ff8c9ba533 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:32.664545 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-94830f8f-0417-4b8d-9d52-b5ff8c9ba533 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:32.665025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-94830f8f-0417-4b8d-9d52-b5ff8c9ba533 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:32.665457 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-94830f8f-0417-4b8d-9d52-b5ff8c9ba533 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:32.666141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-94830f8f-0417-4b8d-9d52-b5ff8c9ba533 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:32.666591 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-94830f8f-0417-4b8d-9d52-b5ff8c9ba533 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:32.667013 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-94830f8f-0417-4b8d-9d52-b5ff8c9ba533 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:32.670925 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=100 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:31:32.792605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-94830f8f-0417-4b8d-9d52-b5ff8c9ba533 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:32.800578 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-94830f8f-0417-4b8d-9d52-b5ff8c9ba533 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.146954 Oct 27 17:31:32.801143 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 104/211] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:32 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:33.279626 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-83efb109-723a-4c51-8829-b1d8dd133013 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:33.280264 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-83efb109-723a-4c51-8829-b1d8dd133013 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:33.286133 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83efb109-723a-4c51-8829-b1d8dd133013 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:33.286686 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83efb109-723a-4c51-8829-b1d8dd133013 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:33.289784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83efb109-723a-4c51-8829-b1d8dd133013 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:33.289784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83efb109-723a-4c51-8829-b1d8dd133013 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:33.289784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83efb109-723a-4c51-8829-b1d8dd133013 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:33.289784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83efb109-723a-4c51-8829-b1d8dd133013 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:33.413482 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-83efb109-723a-4c51-8829-b1d8dd133013 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:33.421041 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-83efb109-723a-4c51-8829-b1d8dd133013 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.145182 Oct 27 17:31:33.421599 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 108/212] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:33 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:33.522290 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-fc55b994-0068-4259-851e-de54f50e6c31 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:33.522890 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-fc55b994-0068-4259-851e-de54f50e6c31 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:33.528780 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fc55b994-0068-4259-851e-de54f50e6c31 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:33.529251 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fc55b994-0068-4259-851e-de54f50e6c31 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:33.529675 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fc55b994-0068-4259-851e-de54f50e6c31 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:33.530340 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fc55b994-0068-4259-851e-de54f50e6c31 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:33.530781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fc55b994-0068-4259-851e-de54f50e6c31 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:33.531191 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fc55b994-0068-4259-851e-de54f50e6c31 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:33.576886 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-e1107d6e-20df-4151-a95f-42861d5a934d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:33.577313 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e1107d6e-20df-4151-a95f-42861d5a934d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:33.583783 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e1107d6e-20df-4151-a95f-42861d5a934d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:33.584269 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e1107d6e-20df-4151-a95f-42861d5a934d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:33.584695 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e1107d6e-20df-4151-a95f-42861d5a934d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:33.585389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e1107d6e-20df-4151-a95f-42861d5a934d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:33.585838 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e1107d6e-20df-4151-a95f-42861d5a934d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:33.586257 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e1107d6e-20df-4151-a95f-42861d5a934d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:33.661099 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-fc55b994-0068-4259-851e-de54f50e6c31 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:33.669416 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-fc55b994-0068-4259-851e-de54f50e6c31 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:33.670859 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-fc55b994-0068-4259-851e-de54f50e6c31 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:33.671979 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-fc55b994-0068-4259-851e-de54f50e6c31 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.153513 Oct 27 17:31:33.672536 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 105/213] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:33 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:31:33.720061 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e1107d6e-20df-4151-a95f-42861d5a934d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:33.728594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-e1107d6e-20df-4151-a95f-42861d5a934d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.155313 Oct 27 17:31:33.729422 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 109/214] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:33 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:33.822887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-19780b48-990a-47a5-960b-0084b323bdd7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:33.823496 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-19780b48-990a-47a5-960b-0084b323bdd7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:33.829402 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-19780b48-990a-47a5-960b-0084b323bdd7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:33.829875 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-19780b48-990a-47a5-960b-0084b323bdd7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:33.830301 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-19780b48-990a-47a5-960b-0084b323bdd7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:33.831018 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-19780b48-990a-47a5-960b-0084b323bdd7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:33.831464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-19780b48-990a-47a5-960b-0084b323bdd7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:33.831909 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-19780b48-990a-47a5-960b-0084b323bdd7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:33.959956 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-19780b48-990a-47a5-960b-0084b323bdd7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:33.967477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-19780b48-990a-47a5-960b-0084b323bdd7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.148434 Oct 27 17:31:33.968077 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 106/215] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:33 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:34.444577 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-750b388d-d8a6-48f8-8b13-614929b9b4cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:34.445189 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-750b388d-d8a6-48f8-8b13-614929b9b4cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:34.451081 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-750b388d-d8a6-48f8-8b13-614929b9b4cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:34.451558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-750b388d-d8a6-48f8-8b13-614929b9b4cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:34.452022 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-750b388d-d8a6-48f8-8b13-614929b9b4cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:34.452705 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-750b388d-d8a6-48f8-8b13-614929b9b4cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:34.453156 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-750b388d-d8a6-48f8-8b13-614929b9b4cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:34.453586 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-750b388d-d8a6-48f8-8b13-614929b9b4cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:34.578337 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-750b388d-d8a6-48f8-8b13-614929b9b4cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:34.585916 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-750b388d-d8a6-48f8-8b13-614929b9b4cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.145863 Oct 27 17:31:34.586482 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 110/216] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:34 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:34.698760 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-5a80d50b-3c56-4e71-930d-aaf105f7c943 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:34.699366 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-5a80d50b-3c56-4e71-930d-aaf105f7c943 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:34.705251 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a80d50b-3c56-4e71-930d-aaf105f7c943 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:34.705734 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a80d50b-3c56-4e71-930d-aaf105f7c943 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:34.706162 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a80d50b-3c56-4e71-930d-aaf105f7c943 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:34.706840 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a80d50b-3c56-4e71-930d-aaf105f7c943 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:34.707287 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a80d50b-3c56-4e71-930d-aaf105f7c943 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:34.707703 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a80d50b-3c56-4e71-930d-aaf105f7c943 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:34.750561 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-57959c41-2edf-4945-a914-5e918efea3ab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:34.751429 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-57959c41-2edf-4945-a914-5e918efea3ab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:34.760702 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-57959c41-2edf-4945-a914-5e918efea3ab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:34.760702 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-57959c41-2edf-4945-a914-5e918efea3ab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:34.760702 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-57959c41-2edf-4945-a914-5e918efea3ab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:34.760702 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-57959c41-2edf-4945-a914-5e918efea3ab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:34.761051 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-57959c41-2edf-4945-a914-5e918efea3ab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:34.761051 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-57959c41-2edf-4945-a914-5e918efea3ab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:34.838804 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5a80d50b-3c56-4e71-930d-aaf105f7c943 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:34.847395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5a80d50b-3c56-4e71-930d-aaf105f7c943 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:34.848869 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5a80d50b-3c56-4e71-930d-aaf105f7c943 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:34.849968 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-5a80d50b-3c56-4e71-930d-aaf105f7c943 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.155002 Oct 27 17:31:34.850526 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 107/217] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:34 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:34.887586 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-57959c41-2edf-4945-a914-5e918efea3ab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:34.895660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-57959c41-2edf-4945-a914-5e918efea3ab tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.148937 Oct 27 17:31:34.896244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 111/218] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:34 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:34.991548 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b99a1809-2d17-469e-b4e2-16a8f7a6da0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:34.992177 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b99a1809-2d17-469e-b4e2-16a8f7a6da0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:34.998027 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b99a1809-2d17-469e-b4e2-16a8f7a6da0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:34.998507 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b99a1809-2d17-469e-b4e2-16a8f7a6da0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:34.998934 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b99a1809-2d17-469e-b4e2-16a8f7a6da0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:34.999615 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b99a1809-2d17-469e-b4e2-16a8f7a6da0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:35.000104 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b99a1809-2d17-469e-b4e2-16a8f7a6da0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:35.000519 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b99a1809-2d17-469e-b4e2-16a8f7a6da0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:35.132142 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b99a1809-2d17-469e-b4e2-16a8f7a6da0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:35.139655 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b99a1809-2d17-469e-b4e2-16a8f7a6da0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.152649 Oct 27 17:31:35.140239 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 108/219] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:34 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:35.609019 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c8efa38f-14a1-44da-b86d-2c4948caadea tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:35.609584 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c8efa38f-14a1-44da-b86d-2c4948caadea tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:35.616079 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c8efa38f-14a1-44da-b86d-2c4948caadea tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:35.616551 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c8efa38f-14a1-44da-b86d-2c4948caadea tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:35.616976 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c8efa38f-14a1-44da-b86d-2c4948caadea tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:35.617646 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c8efa38f-14a1-44da-b86d-2c4948caadea tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:35.618191 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c8efa38f-14a1-44da-b86d-2c4948caadea tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:35.618606 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c8efa38f-14a1-44da-b86d-2c4948caadea tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:35.755158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c8efa38f-14a1-44da-b86d-2c4948caadea tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:35.762894 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c8efa38f-14a1-44da-b86d-2c4948caadea tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.158056 Oct 27 17:31:35.763462 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 112/220] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:35 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:35.874322 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-dc458eae-c475-48ad-902f-aee4f2cca5cd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:35.874862 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-dc458eae-c475-48ad-902f-aee4f2cca5cd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:35.881360 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dc458eae-c475-48ad-902f-aee4f2cca5cd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:35.881842 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dc458eae-c475-48ad-902f-aee4f2cca5cd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:35.882281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dc458eae-c475-48ad-902f-aee4f2cca5cd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:35.882965 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dc458eae-c475-48ad-902f-aee4f2cca5cd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:35.883418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dc458eae-c475-48ad-902f-aee4f2cca5cd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:35.883863 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dc458eae-c475-48ad-902f-aee4f2cca5cd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:35.916932 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-cb567202-690b-49d7-b38b-a3a4ecbb4563 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:35.917539 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-cb567202-690b-49d7-b38b-a3a4ecbb4563 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:35.923558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cb567202-690b-49d7-b38b-a3a4ecbb4563 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:35.924089 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cb567202-690b-49d7-b38b-a3a4ecbb4563 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:35.925018 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cb567202-690b-49d7-b38b-a3a4ecbb4563 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:35.925714 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cb567202-690b-49d7-b38b-a3a4ecbb4563 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:35.926166 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cb567202-690b-49d7-b38b-a3a4ecbb4563 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:35.926586 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cb567202-690b-49d7-b38b-a3a4ecbb4563 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:36.008839 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-dc458eae-c475-48ad-902f-aee4f2cca5cd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:36.017188 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-dc458eae-c475-48ad-902f-aee4f2cca5cd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:36.018704 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-dc458eae-c475-48ad-902f-aee4f2cca5cd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:36.019879 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-dc458eae-c475-48ad-902f-aee4f2cca5cd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.149477 Oct 27 17:31:36.020464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 109/221] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:35 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:36.052253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-cb567202-690b-49d7-b38b-a3a4ecbb4563 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:36.059785 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-cb567202-690b-49d7-b38b-a3a4ecbb4563 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.146655 Oct 27 17:31:36.060357 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 113/222] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:35 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:36.162048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-737d8ad5-fb73-49b7-8fa6-0acba1855dea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:36.162624 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-737d8ad5-fb73-49b7-8fa6-0acba1855dea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:36.168502 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-737d8ad5-fb73-49b7-8fa6-0acba1855dea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:36.168983 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-737d8ad5-fb73-49b7-8fa6-0acba1855dea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:36.169418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-737d8ad5-fb73-49b7-8fa6-0acba1855dea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:36.170096 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-737d8ad5-fb73-49b7-8fa6-0acba1855dea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:36.170552 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-737d8ad5-fb73-49b7-8fa6-0acba1855dea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:36.170969 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-737d8ad5-fb73-49b7-8fa6-0acba1855dea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:36.305029 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-737d8ad5-fb73-49b7-8fa6-0acba1855dea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:36.313084 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-737d8ad5-fb73-49b7-8fa6-0acba1855dea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.154886 Oct 27 17:31:36.313650 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 110/223] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:36 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:36.681204 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-b4f58558-2eef-461d-b716-aaf90c9ac7dc req-8c5ca54b-760c-4a9d-a554-334a0a1705be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c65005a-985e-4fae-a09d-8cfc17bc9e93", "name": "network-vif-plugged", "status": "completed", "tag": "ed86609d-1807-41a9-9302-15671bc13ea6"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:31:36.695077 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-b4f58558-2eef-461d-b716-aaf90c9ac7dc req-8c5ca54b-760c-4a9d-a554-334a0a1705be service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:36.695820 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-b4f58558-2eef-461d-b716-aaf90c9ac7dc req-8c5ca54b-760c-4a9d-a554-334a0a1705be service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:36.696586 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-b4f58558-2eef-461d-b716-aaf90c9ac7dc req-8c5ca54b-760c-4a9d-a554-334a0a1705be service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:36.709350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-b4f58558-2eef-461d-b716-aaf90c9ac7dc req-8c5ca54b-760c-4a9d-a554-334a0a1705be service nova] Creating event network-vif-plugged:ed86609d-1807-41a9-9302-15671bc13ea6 for instance 3c65005a-985e-4fae-a09d-8cfc17bc9e93 on hv-cinder-86283 Oct 27 17:31:36.714855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-b4f58558-2eef-461d-b716-aaf90c9ac7dc req-8c5ca54b-760c-4a9d-a554-334a0a1705be service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039392 Oct 27 17:31:36.715796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 114/224] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:31:36.786741 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6b2bc659-34b7-4734-b8ce-bcd211e384fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:36.787352 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6b2bc659-34b7-4734-b8ce-bcd211e384fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:36.793423 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b2bc659-34b7-4734-b8ce-bcd211e384fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:36.793872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b2bc659-34b7-4734-b8ce-bcd211e384fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:36.794306 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b2bc659-34b7-4734-b8ce-bcd211e384fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:36.794996 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b2bc659-34b7-4734-b8ce-bcd211e384fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:36.795596 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b2bc659-34b7-4734-b8ce-bcd211e384fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:36.796285 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b2bc659-34b7-4734-b8ce-bcd211e384fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:36.946311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-6b2bc659-34b7-4734-b8ce-bcd211e384fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:36.954224 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6b2bc659-34b7-4734-b8ce-bcd211e384fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.172602 Oct 27 17:31:36.954908 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 111/225] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:36 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:37.045952 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0e03cc57-9cdb-4e44-8e30-f3573c5ef6f5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:37.046667 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-0e03cc57-9cdb-4e44-8e30-f3573c5ef6f5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:37.053018 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e03cc57-9cdb-4e44-8e30-f3573c5ef6f5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:37.053489 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e03cc57-9cdb-4e44-8e30-f3573c5ef6f5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:37.053916 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e03cc57-9cdb-4e44-8e30-f3573c5ef6f5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:37.054592 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e03cc57-9cdb-4e44-8e30-f3573c5ef6f5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:37.055034 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e03cc57-9cdb-4e44-8e30-f3573c5ef6f5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:37.055447 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e03cc57-9cdb-4e44-8e30-f3573c5ef6f5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:37.083291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ab159654-df98-4865-adf5-d8f1f327137c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:37.083925 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ab159654-df98-4865-adf5-d8f1f327137c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:37.089798 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ab159654-df98-4865-adf5-d8f1f327137c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:37.090276 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ab159654-df98-4865-adf5-d8f1f327137c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:37.090705 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ab159654-df98-4865-adf5-d8f1f327137c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:37.091382 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ab159654-df98-4865-adf5-d8f1f327137c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:37.092253 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ab159654-df98-4865-adf5-d8f1f327137c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:37.092728 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ab159654-df98-4865-adf5-d8f1f327137c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:37.192562 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-0e03cc57-9cdb-4e44-8e30-f3573c5ef6f5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:37.200634 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-0e03cc57-9cdb-4e44-8e30-f3573c5ef6f5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:37.202031 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-0e03cc57-9cdb-4e44-8e30-f3573c5ef6f5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:37.203124 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0e03cc57-9cdb-4e44-8e30-f3573c5ef6f5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.161617 Oct 27 17:31:37.203670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 115/226] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:37 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:37.226269 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ab159654-df98-4865-adf5-d8f1f327137c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:37.234127 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ab159654-df98-4865-adf5-d8f1f327137c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.155228 Oct 27 17:31:37.234675 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 112/227] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:37 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:37.335942 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-9f17b6c4-b921-4b97-ba3a-dfc1f8c689f0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:37.336551 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-9f17b6c4-b921-4b97-ba3a-dfc1f8c689f0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:37.342617 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f17b6c4-b921-4b97-ba3a-dfc1f8c689f0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:37.343244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f17b6c4-b921-4b97-ba3a-dfc1f8c689f0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:37.343676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f17b6c4-b921-4b97-ba3a-dfc1f8c689f0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:37.344372 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f17b6c4-b921-4b97-ba3a-dfc1f8c689f0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:37.344868 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f17b6c4-b921-4b97-ba3a-dfc1f8c689f0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:37.345284 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f17b6c4-b921-4b97-ba3a-dfc1f8c689f0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:37.468366 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9f17b6c4-b921-4b97-ba3a-dfc1f8c689f0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:37.476565 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-9f17b6c4-b921-4b97-ba3a-dfc1f8c689f0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.144450 Oct 27 17:31:37.477133 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 116/228] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:37 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:37.583684 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-434db07c-49ba-437b-adaf-7369fb7a4318 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c5d5c42-fbed-4f79-b67c-1b47c0e1398d"}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:31:37.586160 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-434db07c-49ba-437b-adaf-7369fb7a4318 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:37.591896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-434db07c-49ba-437b-adaf-7369fb7a4318 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:37.592380 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-434db07c-49ba-437b-adaf-7369fb7a4318 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:37.592925 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-434db07c-49ba-437b-adaf-7369fb7a4318 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:37.593486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-434db07c-49ba-437b-adaf-7369fb7a4318 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:37.593935 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-434db07c-49ba-437b-adaf-7369fb7a4318 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:37.594356 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-434db07c-49ba-437b-adaf-7369fb7a4318 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:37.977761 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6b97952f-5e9d-40ab-a833-57d46d48d67e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:37.978455 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-6b97952f-5e9d-40ab-a833-57d46d48d67e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:37.984768 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b97952f-5e9d-40ab-a833-57d46d48d67e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:37.985250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b97952f-5e9d-40ab-a833-57d46d48d67e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:37.985678 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b97952f-5e9d-40ab-a833-57d46d48d67e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:37.986365 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b97952f-5e9d-40ab-a833-57d46d48d67e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:37.986839 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b97952f-5e9d-40ab-a833-57d46d48d67e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:37.987256 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b97952f-5e9d-40ab-a833-57d46d48d67e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:38.296028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-6b97952f-5e9d-40ab-a833-57d46d48d67e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:38.303541 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6b97952f-5e9d-40ab-a833-57d46d48d67e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.329761 Oct 27 17:31:38.304132 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 117/229] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:37 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:38.308634 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-98b6d366-4fa0-4bf5-96de-3ccac13fcf7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:38.309235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-98b6d366-4fa0-4bf5-96de-3ccac13fcf7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:38.315517 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-98b6d366-4fa0-4bf5-96de-3ccac13fcf7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:38.316025 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-98b6d366-4fa0-4bf5-96de-3ccac13fcf7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:38.316453 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-98b6d366-4fa0-4bf5-96de-3ccac13fcf7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:38.317141 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-98b6d366-4fa0-4bf5-96de-3ccac13fcf7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:38.317586 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-98b6d366-4fa0-4bf5-96de-3ccac13fcf7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:38.318007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-98b6d366-4fa0-4bf5-96de-3ccac13fcf7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:38.438709 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-98b6d366-4fa0-4bf5-96de-3ccac13fcf7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:38.447202 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-98b6d366-4fa0-4bf5-96de-3ccac13fcf7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:38.448672 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-98b6d366-4fa0-4bf5-96de-3ccac13fcf7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:38.449758 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-98b6d366-4fa0-4bf5-96de-3ccac13fcf7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.144720 Oct 27 17:31:38.450315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 118/230] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:38 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:38.454583 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-eb87bc4f-5e78-4ce5-8718-016f4c97ecc3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:38.455180 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-eb87bc4f-5e78-4ce5-8718-016f4c97ecc3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:38.461390 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eb87bc4f-5e78-4ce5-8718-016f4c97ecc3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:38.461873 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eb87bc4f-5e78-4ce5-8718-016f4c97ecc3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:38.462305 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eb87bc4f-5e78-4ce5-8718-016f4c97ecc3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:38.462986 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eb87bc4f-5e78-4ce5-8718-016f4c97ecc3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:38.463464 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eb87bc4f-5e78-4ce5-8718-016f4c97ecc3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:38.463913 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eb87bc4f-5e78-4ce5-8718-016f4c97ecc3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:38.590467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-eb87bc4f-5e78-4ce5-8718-016f4c97ecc3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:38.598040 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-eb87bc4f-5e78-4ce5-8718-016f4c97ecc3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.146804 Oct 27 17:31:38.598600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 119/231] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:38 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:38.602930 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2638d09d-ec7e-45f4-8d08-5060d8b40aaa tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:38.603527 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2638d09d-ec7e-45f4-8d08-5060d8b40aaa tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:38.609216 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2638d09d-ec7e-45f4-8d08-5060d8b40aaa tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:38.609686 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2638d09d-ec7e-45f4-8d08-5060d8b40aaa tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:38.610187 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2638d09d-ec7e-45f4-8d08-5060d8b40aaa tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:38.610794 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2638d09d-ec7e-45f4-8d08-5060d8b40aaa tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:38.611261 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2638d09d-ec7e-45f4-8d08-5060d8b40aaa tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:38.611681 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2638d09d-ec7e-45f4-8d08-5060d8b40aaa tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:38.736312 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2638d09d-ec7e-45f4-8d08-5060d8b40aaa tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:38.744452 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2638d09d-ec7e-45f4-8d08-5060d8b40aaa tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.144928 Oct 27 17:31:38.745006 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 120/232] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:38 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:39.328614 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2e682cf6-8117-4d32-bef8-648f9c49b823 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:39.329246 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2e682cf6-8117-4d32-bef8-648f9c49b823 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:39.335116 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e682cf6-8117-4d32-bef8-648f9c49b823 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:39.335597 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e682cf6-8117-4d32-bef8-648f9c49b823 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:39.336061 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e682cf6-8117-4d32-bef8-648f9c49b823 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:39.336746 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e682cf6-8117-4d32-bef8-648f9c49b823 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:39.337193 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e682cf6-8117-4d32-bef8-648f9c49b823 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:39.337613 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e682cf6-8117-4d32-bef8-648f9c49b823 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:39.461869 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2e682cf6-8117-4d32-bef8-648f9c49b823 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:39.469434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2e682cf6-8117-4d32-bef8-648f9c49b823 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.144860 Oct 27 17:31:39.469994 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 121/233] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:39 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:39.475225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-73f61f33-61cc-4a8a-b5d7-ab9b02958cd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:39.475787 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-73f61f33-61cc-4a8a-b5d7-ab9b02958cd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:39.481220 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-73f61f33-61cc-4a8a-b5d7-ab9b02958cd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:39.481957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-73f61f33-61cc-4a8a-b5d7-ab9b02958cd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:39.482400 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-73f61f33-61cc-4a8a-b5d7-ab9b02958cd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:39.483061 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-73f61f33-61cc-4a8a-b5d7-ab9b02958cd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:39.483510 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-73f61f33-61cc-4a8a-b5d7-ab9b02958cd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:39.483956 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-73f61f33-61cc-4a8a-b5d7-ab9b02958cd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:39.610680 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-73f61f33-61cc-4a8a-b5d7-ab9b02958cd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:39.618770 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-73f61f33-61cc-4a8a-b5d7-ab9b02958cd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:39.620290 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-73f61f33-61cc-4a8a-b5d7-ab9b02958cd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:39.621379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-73f61f33-61cc-4a8a-b5d7-ab9b02958cd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.150490 Oct 27 17:31:39.621932 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 122/234] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:39 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:31:39.626335 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-55d765b0-753c-4cfe-8be1-621bf7b1b7eb tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:39.626930 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-55d765b0-753c-4cfe-8be1-621bf7b1b7eb tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:39.632872 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-55d765b0-753c-4cfe-8be1-621bf7b1b7eb tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:39.633363 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-55d765b0-753c-4cfe-8be1-621bf7b1b7eb tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:39.633797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-55d765b0-753c-4cfe-8be1-621bf7b1b7eb tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:39.634485 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-55d765b0-753c-4cfe-8be1-621bf7b1b7eb tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:39.634935 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-55d765b0-753c-4cfe-8be1-621bf7b1b7eb tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:39.635357 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-55d765b0-753c-4cfe-8be1-621bf7b1b7eb tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:39.759131 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-55d765b0-753c-4cfe-8be1-621bf7b1b7eb tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:39.766886 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-55d765b0-753c-4cfe-8be1-621bf7b1b7eb tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.143957 Oct 27 17:31:39.767451 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 123/235] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:39 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:39.771882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-7976e864-cde9-41e7-af8f-912aacf590bf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:39.772485 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-7976e864-cde9-41e7-af8f-912aacf590bf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:39.777938 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7976e864-cde9-41e7-af8f-912aacf590bf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:39.778416 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7976e864-cde9-41e7-af8f-912aacf590bf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:39.778846 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7976e864-cde9-41e7-af8f-912aacf590bf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:39.779526 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7976e864-cde9-41e7-af8f-912aacf590bf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:39.779999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7976e864-cde9-41e7-af8f-912aacf590bf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:39.780419 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7976e864-cde9-41e7-af8f-912aacf590bf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:39.909039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7976e864-cde9-41e7-af8f-912aacf590bf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:39.912569 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=100 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:31:39.917441 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-7976e864-cde9-41e7-af8f-912aacf590bf tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.148983 Oct 27 17:31:39.918043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 124/236] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:39 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:40.492746 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1479d70b-c5d8-4ff3-a721-4f9faa330f72 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:40.493361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-1479d70b-c5d8-4ff3-a721-4f9faa330f72 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:40.499413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1479d70b-c5d8-4ff3-a721-4f9faa330f72 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:40.499933 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1479d70b-c5d8-4ff3-a721-4f9faa330f72 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:40.500367 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1479d70b-c5d8-4ff3-a721-4f9faa330f72 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:40.501061 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1479d70b-c5d8-4ff3-a721-4f9faa330f72 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:40.501496 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1479d70b-c5d8-4ff3-a721-4f9faa330f72 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:40.501913 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1479d70b-c5d8-4ff3-a721-4f9faa330f72 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:40.629226 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1479d70b-c5d8-4ff3-a721-4f9faa330f72 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:40.636795 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1479d70b-c5d8-4ff3-a721-4f9faa330f72 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.147919 Oct 27 17:31:40.637356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 125/237] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:40 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:40.645885 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1da30be8-fdd3-4120-a0b4-b9e1b7da8531 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:40.646486 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-1da30be8-fdd3-4120-a0b4-b9e1b7da8531 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:40.652154 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1da30be8-fdd3-4120-a0b4-b9e1b7da8531 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:40.652650 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1da30be8-fdd3-4120-a0b4-b9e1b7da8531 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:40.653062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1da30be8-fdd3-4120-a0b4-b9e1b7da8531 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:40.653740 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1da30be8-fdd3-4120-a0b4-b9e1b7da8531 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:40.654186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1da30be8-fdd3-4120-a0b4-b9e1b7da8531 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:40.654609 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1da30be8-fdd3-4120-a0b4-b9e1b7da8531 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:40.781770 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1da30be8-fdd3-4120-a0b4-b9e1b7da8531 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:40.791033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1da30be8-fdd3-4120-a0b4-b9e1b7da8531 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:40.792493 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1da30be8-fdd3-4120-a0b4-b9e1b7da8531 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:40.793581 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1da30be8-fdd3-4120-a0b4-b9e1b7da8531 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.151337 Oct 27 17:31:40.794128 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 126/238] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:40 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:31:40.798421 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-63693f29-f32c-4d38-b819-e963eb660a69 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:40.799011 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-63693f29-f32c-4d38-b819-e963eb660a69 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:40.804987 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63693f29-f32c-4d38-b819-e963eb660a69 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:40.805455 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63693f29-f32c-4d38-b819-e963eb660a69 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:40.805878 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63693f29-f32c-4d38-b819-e963eb660a69 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:40.806550 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63693f29-f32c-4d38-b819-e963eb660a69 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:40.806995 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63693f29-f32c-4d38-b819-e963eb660a69 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:40.807408 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63693f29-f32c-4d38-b819-e963eb660a69 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:40.930045 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-63693f29-f32c-4d38-b819-e963eb660a69 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:40.937709 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-63693f29-f32c-4d38-b819-e963eb660a69 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.142660 Oct 27 17:31:40.938260 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 127/239] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:40 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:40.942687 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-28b92454-aba1-4e5d-b70e-3f39139fce38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:40.943277 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-28b92454-aba1-4e5d-b70e-3f39139fce38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:40.948802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-28b92454-aba1-4e5d-b70e-3f39139fce38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:40.949284 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-28b92454-aba1-4e5d-b70e-3f39139fce38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:40.949710 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-28b92454-aba1-4e5d-b70e-3f39139fce38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:40.950383 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-28b92454-aba1-4e5d-b70e-3f39139fce38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:40.950825 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-28b92454-aba1-4e5d-b70e-3f39139fce38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:40.951240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-28b92454-aba1-4e5d-b70e-3f39139fce38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:41.077022 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-28b92454-aba1-4e5d-b70e-3f39139fce38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:41.085121 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-28b92454-aba1-4e5d-b70e-3f39139fce38 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.145944 Oct 27 17:31:41.085687 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 128/240] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:40 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:41.661259 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-bc0b74d0-1cc9-42c7-b879-7908dac1efec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:41.661831 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-bc0b74d0-1cc9-42c7-b879-7908dac1efec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:41.667879 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bc0b74d0-1cc9-42c7-b879-7908dac1efec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:41.668360 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bc0b74d0-1cc9-42c7-b879-7908dac1efec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:41.668792 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bc0b74d0-1cc9-42c7-b879-7908dac1efec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:41.669481 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bc0b74d0-1cc9-42c7-b879-7908dac1efec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:41.669929 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bc0b74d0-1cc9-42c7-b879-7908dac1efec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:41.670346 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bc0b74d0-1cc9-42c7-b879-7908dac1efec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:41.798038 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-bc0b74d0-1cc9-42c7-b879-7908dac1efec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:41.806154 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-bc0b74d0-1cc9-42c7-b879-7908dac1efec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.149709 Oct 27 17:31:41.806716 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 129/241] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:41 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:41.818468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-321df7e9-7c53-41ce-8cf0-06b0c5cd2ce2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:41.819093 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-321df7e9-7c53-41ce-8cf0-06b0c5cd2ce2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:41.824578 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-321df7e9-7c53-41ce-8cf0-06b0c5cd2ce2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:41.825055 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-321df7e9-7c53-41ce-8cf0-06b0c5cd2ce2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:41.825485 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-321df7e9-7c53-41ce-8cf0-06b0c5cd2ce2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:41.826192 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-321df7e9-7c53-41ce-8cf0-06b0c5cd2ce2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:41.826639 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-321df7e9-7c53-41ce-8cf0-06b0c5cd2ce2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:41.827062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-321df7e9-7c53-41ce-8cf0-06b0c5cd2ce2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:41.949270 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-321df7e9-7c53-41ce-8cf0-06b0c5cd2ce2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:41.957578 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-321df7e9-7c53-41ce-8cf0-06b0c5cd2ce2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:41.959025 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-321df7e9-7c53-41ce-8cf0-06b0c5cd2ce2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:41.960154 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-321df7e9-7c53-41ce-8cf0-06b0c5cd2ce2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.145817 Oct 27 17:31:41.960861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 130/242] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:41 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:31:41.965123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-50852a72-9d7d-4b23-baa9-fc7b23492daf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:41.965720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-50852a72-9d7d-4b23-baa9-fc7b23492daf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:41.971142 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-50852a72-9d7d-4b23-baa9-fc7b23492daf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:41.971616 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-50852a72-9d7d-4b23-baa9-fc7b23492daf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:41.972081 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-50852a72-9d7d-4b23-baa9-fc7b23492daf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:41.972768 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-50852a72-9d7d-4b23-baa9-fc7b23492daf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:41.973216 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-50852a72-9d7d-4b23-baa9-fc7b23492daf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:41.973635 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-50852a72-9d7d-4b23-baa9-fc7b23492daf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:42.104332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-50852a72-9d7d-4b23-baa9-fc7b23492daf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:42.112232 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-50852a72-9d7d-4b23-baa9-fc7b23492daf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.150562 Oct 27 17:31:42.112793 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 131/243] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:41 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:42.117087 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-80fb4f30-69cc-4630-904c-181a15c3a65b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:42.117681 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-80fb4f30-69cc-4630-904c-181a15c3a65b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:42.124364 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80fb4f30-69cc-4630-904c-181a15c3a65b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:42.124843 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80fb4f30-69cc-4630-904c-181a15c3a65b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:42.125278 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80fb4f30-69cc-4630-904c-181a15c3a65b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:42.125947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80fb4f30-69cc-4630-904c-181a15c3a65b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:42.126394 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80fb4f30-69cc-4630-904c-181a15c3a65b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:42.126815 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80fb4f30-69cc-4630-904c-181a15c3a65b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:42.250092 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-80fb4f30-69cc-4630-904c-181a15c3a65b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:42.258233 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-80fb4f30-69cc-4630-904c-181a15c3a65b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.144504 Oct 27 17:31:42.258797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 132/244] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:42 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:42.828759 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b073e72a-a1c8-40c4-a032-66eceb831f43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:42.829360 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b073e72a-a1c8-40c4-a032-66eceb831f43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:42.835839 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b073e72a-a1c8-40c4-a032-66eceb831f43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:42.836324 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b073e72a-a1c8-40c4-a032-66eceb831f43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:42.836752 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b073e72a-a1c8-40c4-a032-66eceb831f43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:42.837427 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b073e72a-a1c8-40c4-a032-66eceb831f43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:42.837873 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b073e72a-a1c8-40c4-a032-66eceb831f43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:42.838290 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b073e72a-a1c8-40c4-a032-66eceb831f43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:42.969205 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-b073e72a-a1c8-40c4-a032-66eceb831f43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:42.978010 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b073e72a-a1c8-40c4-a032-66eceb831f43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.153013 Oct 27 17:31:42.978601 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 133/245] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:42 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:42.989592 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-fc7abbf5-7c62-4156-8630-c567379a9b38 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:42.990155 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-fc7abbf5-7c62-4156-8630-c567379a9b38 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:42.992959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=100 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:31:42.996697 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fc7abbf5-7c62-4156-8630-c567379a9b38 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:42.997181 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fc7abbf5-7c62-4156-8630-c567379a9b38 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:42.997636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fc7abbf5-7c62-4156-8630-c567379a9b38 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:42.998352 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fc7abbf5-7c62-4156-8630-c567379a9b38 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:42.998773 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fc7abbf5-7c62-4156-8630-c567379a9b38 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:42.999193 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fc7abbf5-7c62-4156-8630-c567379a9b38 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:43.138348 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fc7abbf5-7c62-4156-8630-c567379a9b38 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:43.152244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fc7abbf5-7c62-4156-8630-c567379a9b38 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:43.154026 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fc7abbf5-7c62-4156-8630-c567379a9b38 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:43.155284 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-fc7abbf5-7c62-4156-8630-c567379a9b38 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.174891 Oct 27 17:31:43.156386 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 134/246] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:42 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:31:43.161644 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5b7f4a40-68f3-45f1-96d7-f7af38f88703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:43.162251 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-5b7f4a40-68f3-45f1-96d7-f7af38f88703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:43.182597 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5b7f4a40-68f3-45f1-96d7-f7af38f88703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:43.183120 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5b7f4a40-68f3-45f1-96d7-f7af38f88703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:43.183548 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5b7f4a40-68f3-45f1-96d7-f7af38f88703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:43.185527 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5b7f4a40-68f3-45f1-96d7-f7af38f88703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:43.186623 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5b7f4a40-68f3-45f1-96d7-f7af38f88703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:43.187277 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5b7f4a40-68f3-45f1-96d7-f7af38f88703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:43.367776 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-5b7f4a40-68f3-45f1-96d7-f7af38f88703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:43.377474 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5b7f4a40-68f3-45f1-96d7-f7af38f88703 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.220165 Oct 27 17:31:43.378521 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 135/247] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:43 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:43.383535 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8e912ba5-7729-4e59-8579-8b23ec5feb68 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:43.384160 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8e912ba5-7729-4e59-8579-8b23ec5feb68 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:43.389751 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8e912ba5-7729-4e59-8579-8b23ec5feb68 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:43.390355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8e912ba5-7729-4e59-8579-8b23ec5feb68 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:43.390791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8e912ba5-7729-4e59-8579-8b23ec5feb68 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:43.391491 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8e912ba5-7729-4e59-8579-8b23ec5feb68 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:43.391956 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8e912ba5-7729-4e59-8579-8b23ec5feb68 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:43.392375 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8e912ba5-7729-4e59-8579-8b23ec5feb68 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:43.525375 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8e912ba5-7729-4e59-8579-8b23ec5feb68 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:43.535235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8e912ba5-7729-4e59-8579-8b23ec5feb68 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.155328 Oct 27 17:31:43.541159 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 136/248] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:43 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:44.003124 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f4ded225-2617-4102-9a5b-fbf53849f81b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:44.003780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f4ded225-2617-4102-9a5b-fbf53849f81b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:44.009676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4ded225-2617-4102-9a5b-fbf53849f81b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:44.010157 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4ded225-2617-4102-9a5b-fbf53849f81b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:44.010587 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4ded225-2617-4102-9a5b-fbf53849f81b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:44.011275 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4ded225-2617-4102-9a5b-fbf53849f81b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:44.011745 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4ded225-2617-4102-9a5b-fbf53849f81b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:44.012171 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4ded225-2617-4102-9a5b-fbf53849f81b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:44.156806 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f4ded225-2617-4102-9a5b-fbf53849f81b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:44.165203 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f4ded225-2617-4102-9a5b-fbf53849f81b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.165920 Oct 27 17:31:44.165768 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 137/249] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:43 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:31:44.185968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-47d2fedd-7ba8-4808-8cf9-2e4ce4bea2e6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:44.186786 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-47d2fedd-7ba8-4808-8cf9-2e4ce4bea2e6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:44.193150 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-47d2fedd-7ba8-4808-8cf9-2e4ce4bea2e6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:44.193626 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-47d2fedd-7ba8-4808-8cf9-2e4ce4bea2e6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:44.194057 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-47d2fedd-7ba8-4808-8cf9-2e4ce4bea2e6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:44.194744 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-47d2fedd-7ba8-4808-8cf9-2e4ce4bea2e6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:44.195193 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-47d2fedd-7ba8-4808-8cf9-2e4ce4bea2e6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:44.195610 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-47d2fedd-7ba8-4808-8cf9-2e4ce4bea2e6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:44.399935 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-47d2fedd-7ba8-4808-8cf9-2e4ce4bea2e6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:44.408176 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-47d2fedd-7ba8-4808-8cf9-2e4ce4bea2e6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:44.409762 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-47d2fedd-7ba8-4808-8cf9-2e4ce4bea2e6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:44.410900 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-47d2fedd-7ba8-4808-8cf9-2e4ce4bea2e6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1408 microversion: 2.20 time: 0.228762 Oct 27 17:31:44.411400 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 138/250] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:44 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:31:44.416561 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-9f7da28f-e886-4858-ba48-a61f3b828360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:44.417247 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-9f7da28f-e886-4858-ba48-a61f3b828360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:44.423193 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f7da28f-e886-4858-ba48-a61f3b828360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:44.423675 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f7da28f-e886-4858-ba48-a61f3b828360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:44.424128 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f7da28f-e886-4858-ba48-a61f3b828360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:44.424968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f7da28f-e886-4858-ba48-a61f3b828360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:44.425422 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f7da28f-e886-4858-ba48-a61f3b828360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:44.425852 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f7da28f-e886-4858-ba48-a61f3b828360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:44.609479 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9f7da28f-e886-4858-ba48-a61f3b828360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:44.617100 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-9f7da28f-e886-4858-ba48-a61f3b828360 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1362 microversion: 2.1 time: 0.204396 Oct 27 17:31:44.617668 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 139/251] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:44 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:44.622184 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-78963e8b-3bad-4a7d-82f8-755580fbfa43 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:44.622785 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-78963e8b-3bad-4a7d-82f8-755580fbfa43 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:44.628826 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-78963e8b-3bad-4a7d-82f8-755580fbfa43 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:44.629309 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-78963e8b-3bad-4a7d-82f8-755580fbfa43 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:44.629743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-78963e8b-3bad-4a7d-82f8-755580fbfa43 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:44.630467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-78963e8b-3bad-4a7d-82f8-755580fbfa43 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:44.631042 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-78963e8b-3bad-4a7d-82f8-755580fbfa43 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:44.632276 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-78963e8b-3bad-4a7d-82f8-755580fbfa43 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:44.789152 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-78963e8b-3bad-4a7d-82f8-755580fbfa43 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:44.797300 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-78963e8b-3bad-4a7d-82f8-755580fbfa43 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.178670 Oct 27 17:31:44.797983 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 140/252] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:44 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:45.190082 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0fb7b99a-b5f2-4c1b-b8a4-b7a5429cdcd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:45.192342 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-0fb7b99a-b5f2-4c1b-b8a4-b7a5429cdcd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:45.211948 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0fb7b99a-b5f2-4c1b-b8a4-b7a5429cdcd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:45.211948 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0fb7b99a-b5f2-4c1b-b8a4-b7a5429cdcd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:45.211948 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0fb7b99a-b5f2-4c1b-b8a4-b7a5429cdcd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:45.211948 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0fb7b99a-b5f2-4c1b-b8a4-b7a5429cdcd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:45.212300 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0fb7b99a-b5f2-4c1b-b8a4-b7a5429cdcd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:45.212300 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0fb7b99a-b5f2-4c1b-b8a4-b7a5429cdcd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:45.237609 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=100 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:31:45.400503 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-0fb7b99a-b5f2-4c1b-b8a4-b7a5429cdcd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:45.409072 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0fb7b99a-b5f2-4c1b-b8a4-b7a5429cdcd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.224453 Oct 27 17:31:45.409930 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 141/253] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:45 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:45.438620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-735fbbbe-1cbb-4bd2-8672-37122fa52dd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:45.440139 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-735fbbbe-1cbb-4bd2-8672-37122fa52dd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:45.447038 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-735fbbbe-1cbb-4bd2-8672-37122fa52dd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:45.447521 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-735fbbbe-1cbb-4bd2-8672-37122fa52dd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:45.448006 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-735fbbbe-1cbb-4bd2-8672-37122fa52dd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:45.449279 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-735fbbbe-1cbb-4bd2-8672-37122fa52dd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:45.449880 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-735fbbbe-1cbb-4bd2-8672-37122fa52dd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:45.450298 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-735fbbbe-1cbb-4bd2-8672-37122fa52dd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:45.600443 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-735fbbbe-1cbb-4bd2-8672-37122fa52dd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:45.609783 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-735fbbbe-1cbb-4bd2-8672-37122fa52dd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:45.611500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-735fbbbe-1cbb-4bd2-8672-37122fa52dd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:45.613203 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-735fbbbe-1cbb-4bd2-8672-37122fa52dd8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1599 microversion: 2.20 time: 0.178264 Oct 27 17:31:45.613768 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 142/254] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:31:45 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1599 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:31:45.639368 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-da171a25-0902-4bc6-b1b8-c23bb1079e7c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:45.640036 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-da171a25-0902-4bc6-b1b8-c23bb1079e7c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:45.646505 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-da171a25-0902-4bc6-b1b8-c23bb1079e7c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:45.646979 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-da171a25-0902-4bc6-b1b8-c23bb1079e7c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:45.647405 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-da171a25-0902-4bc6-b1b8-c23bb1079e7c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:45.648166 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-da171a25-0902-4bc6-b1b8-c23bb1079e7c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:45.648629 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-da171a25-0902-4bc6-b1b8-c23bb1079e7c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:45.649224 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-da171a25-0902-4bc6-b1b8-c23bb1079e7c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:45.781158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-da171a25-0902-4bc6-b1b8-c23bb1079e7c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.146867 Oct 27 17:31:45.781996 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 143/255] 10.222.0.36 () {60 vars in 1316 bytes} [Thu Oct 27 17:31:45 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 17:31:45.787315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-aadb3bbb-b781-4299-a026-0975f1c44a58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:45.787941 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-aadb3bbb-b781-4299-a026-0975f1c44a58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:45.801949 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aadb3bbb-b781-4299-a026-0975f1c44a58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:45.802434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aadb3bbb-b781-4299-a026-0975f1c44a58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:45.802867 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aadb3bbb-b781-4299-a026-0975f1c44a58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:45.803647 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aadb3bbb-b781-4299-a026-0975f1c44a58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:45.804039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aadb3bbb-b781-4299-a026-0975f1c44a58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:45.804460 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aadb3bbb-b781-4299-a026-0975f1c44a58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:46.195514 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-aadb3bbb-b781-4299-a026-0975f1c44a58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:46.209538 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-aadb3bbb-b781-4299-a026-0975f1c44a58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1547 microversion: 2.1 time: 0.426454 Oct 27 17:31:46.211277 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 144/256] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:45 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1547 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:46.234742 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-80f95501-417b-4eb0-8313-8409e60020fb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:46.235401 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-80f95501-417b-4eb0-8313-8409e60020fb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:46.242498 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80f95501-417b-4eb0-8313-8409e60020fb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:46.243072 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80f95501-417b-4eb0-8313-8409e60020fb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:46.243569 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80f95501-417b-4eb0-8313-8409e60020fb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:46.244392 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80f95501-417b-4eb0-8313-8409e60020fb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:46.244913 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80f95501-417b-4eb0-8313-8409e60020fb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:46.245567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80f95501-417b-4eb0-8313-8409e60020fb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:46.874559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-80f95501-417b-4eb0-8313-8409e60020fb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:46.886794 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-80f95501-417b-4eb0-8313-8409e60020fb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1367 microversion: 2.1 time: 0.658480 Oct 27 17:31:46.888465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 145/257] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:46 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1367 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:46.904125 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a7009dee-4da7-4859-b556-e8253885fb4a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:46.904796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a7009dee-4da7-4859-b556-e8253885fb4a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:46.911417 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7009dee-4da7-4859-b556-e8253885fb4a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:46.911963 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7009dee-4da7-4859-b556-e8253885fb4a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:46.912453 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7009dee-4da7-4859-b556-e8253885fb4a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:46.913151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7009dee-4da7-4859-b556-e8253885fb4a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:46.913688 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7009dee-4da7-4859-b556-e8253885fb4a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:46.914137 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7009dee-4da7-4859-b556-e8253885fb4a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:47.053513 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a7009dee-4da7-4859-b556-e8253885fb4a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163704 Oct 27 17:31:47.054097 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 146/258] 10.222.0.36 () {58 vars in 1275 bytes} [Thu Oct 27 17:31:46 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:31:47.061339 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-fca39dd2-acc0-483a-a1bd-ebbdfa6dbfc7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:47.061339 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-fca39dd2-acc0-483a-a1bd-ebbdfa6dbfc7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:47.066200 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fca39dd2-acc0-483a-a1bd-ebbdfa6dbfc7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:47.066685 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fca39dd2-acc0-483a-a1bd-ebbdfa6dbfc7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:47.067239 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fca39dd2-acc0-483a-a1bd-ebbdfa6dbfc7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:47.067837 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fca39dd2-acc0-483a-a1bd-ebbdfa6dbfc7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:47.068289 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fca39dd2-acc0-483a-a1bd-ebbdfa6dbfc7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:47.068709 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fca39dd2-acc0-483a-a1bd-ebbdfa6dbfc7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:47.463439 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-434db07c-49ba-437b-adaf-7369fb7a4318 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "POST /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.884387 Oct 27 17:31:47.465645 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 113/259] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Oct 27 17:31:37 2022] POST /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec/os-volume_attachments => generated 194 bytes in 9887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:31:47.499497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fca39dd2-acc0-483a-a1bd-ebbdfa6dbfc7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:47.531116 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-fca39dd2-acc0-483a-a1bd-ebbdfa6dbfc7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.475758 Oct 27 17:31:47.532504 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 147/260] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:47 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:47.813245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=75 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:31:47.818421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-a9a67649-0e30-44ea-b422-666fb8f4287f req-7a5889ac-f96c-42a8-9633-89773ef04f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b27a822-4c22-45f0-872b-67e5f360f45e", "tag": "8d525473-0013-4431-baf7-e343fbc1a2eb"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:31:47.831263 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-a9a67649-0e30-44ea-b422-666fb8f4287f req-7a5889ac-f96c-42a8-9633-89773ef04f33 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:47.831767 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-a9a67649-0e30-44ea-b422-666fb8f4287f req-7a5889ac-f96c-42a8-9633-89773ef04f33 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:47.832202 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-a9a67649-0e30-44ea-b422-666fb8f4287f req-7a5889ac-f96c-42a8-9633-89773ef04f33 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:47.846817 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-a9a67649-0e30-44ea-b422-666fb8f4287f req-7a5889ac-f96c-42a8-9633-89773ef04f33 service nova] Creating event network-changed:8d525473-0013-4431-baf7-e343fbc1a2eb for instance 2b27a822-4c22-45f0-872b-67e5f360f45e on hv-cinder-86283 Oct 27 17:31:47.852066 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-a9a67649-0e30-44ea-b422-666fb8f4287f req-7a5889ac-f96c-42a8-9633-89773ef04f33 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039975 Oct 27 17:31:47.857170 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 114/261] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:31:47.916228 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5aa0d393-556e-47e3-b620-bf8ac8dffdc0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:47.917643 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-5aa0d393-556e-47e3-b620-bf8ac8dffdc0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:47.927635 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5aa0d393-556e-47e3-b620-bf8ac8dffdc0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:47.928641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5aa0d393-556e-47e3-b620-bf8ac8dffdc0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:47.929398 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5aa0d393-556e-47e3-b620-bf8ac8dffdc0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:47.931155 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5aa0d393-556e-47e3-b620-bf8ac8dffdc0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:47.932012 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5aa0d393-556e-47e3-b620-bf8ac8dffdc0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:47.932592 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5aa0d393-556e-47e3-b620-bf8ac8dffdc0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:48.165228 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-5aa0d393-556e-47e3-b620-bf8ac8dffdc0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:48.174032 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5aa0d393-556e-47e3-b620-bf8ac8dffdc0 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1557 microversion: 2.1 time: 0.267231 Oct 27 17:31:48.196643 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 148/262] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:47 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1557 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:48.209473 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ffbfd5fc-09a9-43de-ac11-c49421c81909 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:48.210357 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ffbfd5fc-09a9-43de-ac11-c49421c81909 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:48.217429 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ffbfd5fc-09a9-43de-ac11-c49421c81909 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:48.218237 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ffbfd5fc-09a9-43de-ac11-c49421c81909 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:48.219063 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ffbfd5fc-09a9-43de-ac11-c49421c81909 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:48.219935 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ffbfd5fc-09a9-43de-ac11-c49421c81909 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:48.221124 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ffbfd5fc-09a9-43de-ac11-c49421c81909 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:48.221693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ffbfd5fc-09a9-43de-ac11-c49421c81909 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:48.452995 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ffbfd5fc-09a9-43de-ac11-c49421c81909 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.248320 Oct 27 17:31:48.458154 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 115/263] 10.222.0.36 () {58 vars in 1275 bytes} [Thu Oct 27 17:31:48 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702/os-interface => generated 284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:31:48.554817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ac167adf-3602-4856-a634-20ee3df9fb70 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:48.555959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-ac167adf-3602-4856-a634-20ee3df9fb70 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:48.566584 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ac167adf-3602-4856-a634-20ee3df9fb70 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:48.569653 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ac167adf-3602-4856-a634-20ee3df9fb70 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:48.570306 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ac167adf-3602-4856-a634-20ee3df9fb70 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:48.572145 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ac167adf-3602-4856-a634-20ee3df9fb70 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:48.575488 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ac167adf-3602-4856-a634-20ee3df9fb70 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:48.576144 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ac167adf-3602-4856-a634-20ee3df9fb70 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:48.870839 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ac167adf-3602-4856-a634-20ee3df9fb70 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:48.884512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-ac167adf-3602-4856-a634-20ee3df9fb70 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.334233 Oct 27 17:31:48.886343 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 149/264] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:48 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:49.630201 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-80aecc9c-cf36-4f35-981c-2f27619dd718 req-defaa38f-8428-4680-b4ef-4cecf35d2138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a9f11af-ebc7-4b43-80e4-e03e24ae3490", "tag": "689c3b28-8322-4e68-94df-67c69ac85d72"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:31:49.648673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-80aecc9c-cf36-4f35-981c-2f27619dd718 req-defaa38f-8428-4680-b4ef-4cecf35d2138 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:49.649611 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-80aecc9c-cf36-4f35-981c-2f27619dd718 req-defaa38f-8428-4680-b4ef-4cecf35d2138 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:49.650728 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-80aecc9c-cf36-4f35-981c-2f27619dd718 req-defaa38f-8428-4680-b4ef-4cecf35d2138 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:49.666544 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-80aecc9c-cf36-4f35-981c-2f27619dd718 req-defaa38f-8428-4680-b4ef-4cecf35d2138 service nova] Creating event network-changed:689c3b28-8322-4e68-94df-67c69ac85d72 for instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 on hv-cinder-86283 Oct 27 17:31:49.675452 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-80aecc9c-cf36-4f35-981c-2f27619dd718 req-defaa38f-8428-4680-b4ef-4cecf35d2138 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059430 Oct 27 17:31:49.677061 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 116/265] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:31:49.909477 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-e5b666c2-6f99-4cad-8128-d63f7b342c54 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:49.910203 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e5b666c2-6f99-4cad-8128-d63f7b342c54 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:49.920370 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e5b666c2-6f99-4cad-8128-d63f7b342c54 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:49.920969 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e5b666c2-6f99-4cad-8128-d63f7b342c54 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:49.922658 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e5b666c2-6f99-4cad-8128-d63f7b342c54 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:49.925792 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e5b666c2-6f99-4cad-8128-d63f7b342c54 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:49.926527 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e5b666c2-6f99-4cad-8128-d63f7b342c54 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:49.929052 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e5b666c2-6f99-4cad-8128-d63f7b342c54 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:50.109022 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-1a4a6c18-7b45-4c55-8111-02c851fb1f2b req-0aa67c3a-ba2c-4c34-8007-00a054b50e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13686e3e-dfd4-4f2e-9781-92321ff85702", "tag": "021b0623-ac50-4080-925e-8bf3d47884b1"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:31:50.134437 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-1a4a6c18-7b45-4c55-8111-02c851fb1f2b req-0aa67c3a-ba2c-4c34-8007-00a054b50e47 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:50.136174 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-1a4a6c18-7b45-4c55-8111-02c851fb1f2b req-0aa67c3a-ba2c-4c34-8007-00a054b50e47 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:50.136626 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-1a4a6c18-7b45-4c55-8111-02c851fb1f2b req-0aa67c3a-ba2c-4c34-8007-00a054b50e47 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:50.152929 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e5b666c2-6f99-4cad-8128-d63f7b342c54 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:50.161732 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-e5b666c2-6f99-4cad-8128-d63f7b342c54 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.256918 Oct 27 17:31:50.165215 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-1a4a6c18-7b45-4c55-8111-02c851fb1f2b req-0aa67c3a-ba2c-4c34-8007-00a054b50e47 service nova] Creating event network-changed:021b0623-ac50-4080-925e-8bf3d47884b1 for instance 13686e3e-dfd4-4f2e-9781-92321ff85702 on hv-cinder-86283 Oct 27 17:31:50.176683 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 150/266] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:49 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:50.178610 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-1a4a6c18-7b45-4c55-8111-02c851fb1f2b req-0aa67c3a-ba2c-4c34-8007-00a054b50e47 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076033 Oct 27 17:31:50.179487 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 117/267] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:31:51.186535 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-67d31257-6849-4977-85d2-0863ee92342f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:51.187140 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-67d31257-6849-4977-85d2-0863ee92342f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:51.196134 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67d31257-6849-4977-85d2-0863ee92342f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:51.197840 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67d31257-6849-4977-85d2-0863ee92342f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:51.198507 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67d31257-6849-4977-85d2-0863ee92342f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:51.199415 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67d31257-6849-4977-85d2-0863ee92342f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:51.200308 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67d31257-6849-4977-85d2-0863ee92342f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:51.200894 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67d31257-6849-4977-85d2-0863ee92342f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:51.456658 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-67d31257-6849-4977-85d2-0863ee92342f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:51.466949 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-67d31257-6849-4977-85d2-0863ee92342f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.284193 Oct 27 17:31:51.469340 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 151/268] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:51 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:52.493083 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-022de30e-69f2-4e80-be36-b49711ed83b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:52.493803 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-022de30e-69f2-4e80-be36-b49711ed83b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:52.506060 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-022de30e-69f2-4e80-be36-b49711ed83b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:52.506804 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-022de30e-69f2-4e80-be36-b49711ed83b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:52.508272 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-022de30e-69f2-4e80-be36-b49711ed83b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:52.510300 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-022de30e-69f2-4e80-be36-b49711ed83b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:52.511949 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-022de30e-69f2-4e80-be36-b49711ed83b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:52.512440 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-022de30e-69f2-4e80-be36-b49711ed83b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:52.698332 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-022de30e-69f2-4e80-be36-b49711ed83b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:52.712387 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-022de30e-69f2-4e80-be36-b49711ed83b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.221318 Oct 27 17:31:52.712387 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 118/269] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:52 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:53.735246 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1e36cb65-d712-49ff-ae8e-f605a6ff5179 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:53.735989 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-1e36cb65-d712-49ff-ae8e-f605a6ff5179 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:53.741978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1e36cb65-d712-49ff-ae8e-f605a6ff5179 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:53.742473 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1e36cb65-d712-49ff-ae8e-f605a6ff5179 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:53.742913 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1e36cb65-d712-49ff-ae8e-f605a6ff5179 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:53.743620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1e36cb65-d712-49ff-ae8e-f605a6ff5179 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:53.744102 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1e36cb65-d712-49ff-ae8e-f605a6ff5179 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:53.744532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1e36cb65-d712-49ff-ae8e-f605a6ff5179 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:53.915848 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1e36cb65-d712-49ff-ae8e-f605a6ff5179 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:53.933569 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1e36cb65-d712-49ff-ae8e-f605a6ff5179 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.204145 Oct 27 17:31:53.934151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 152/270] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:53 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:54.957633 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a95d5462-6c2f-4d39-800f-f8b80a1dd92d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:54.958409 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a95d5462-6c2f-4d39-800f-f8b80a1dd92d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:54.965981 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a95d5462-6c2f-4d39-800f-f8b80a1dd92d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:54.966602 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a95d5462-6c2f-4d39-800f-f8b80a1dd92d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:54.967130 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a95d5462-6c2f-4d39-800f-f8b80a1dd92d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:54.967951 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a95d5462-6c2f-4d39-800f-f8b80a1dd92d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:54.968516 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a95d5462-6c2f-4d39-800f-f8b80a1dd92d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:54.969030 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a95d5462-6c2f-4d39-800f-f8b80a1dd92d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:55.441650 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a95d5462-6c2f-4d39-800f-f8b80a1dd92d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:55.459961 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a95d5462-6c2f-4d39-800f-f8b80a1dd92d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.504767 Oct 27 17:31:55.459961 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 119/271] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:54 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:56.482742 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-666be57c-8492-4511-90c9-dc8dac280657 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:56.483405 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-666be57c-8492-4511-90c9-dc8dac280657 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:56.501587 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-666be57c-8492-4511-90c9-dc8dac280657 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:56.502076 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-666be57c-8492-4511-90c9-dc8dac280657 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:56.502504 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-666be57c-8492-4511-90c9-dc8dac280657 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:56.507329 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-666be57c-8492-4511-90c9-dc8dac280657 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:56.510516 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-666be57c-8492-4511-90c9-dc8dac280657 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:56.510958 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-666be57c-8492-4511-90c9-dc8dac280657 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:56.738165 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-666be57c-8492-4511-90c9-dc8dac280657 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:56.757476 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-666be57c-8492-4511-90c9-dc8dac280657 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.276662 Oct 27 17:31:56.760009 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 153/272] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:56 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:57.785019 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ce379738-9b65-47ae-81ee-38c90eaf6a1f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:57.786747 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ce379738-9b65-47ae-81ee-38c90eaf6a1f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:57.798895 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce379738-9b65-47ae-81ee-38c90eaf6a1f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:57.799383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce379738-9b65-47ae-81ee-38c90eaf6a1f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:57.802443 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce379738-9b65-47ae-81ee-38c90eaf6a1f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:57.808567 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce379738-9b65-47ae-81ee-38c90eaf6a1f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:57.809280 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce379738-9b65-47ae-81ee-38c90eaf6a1f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:57.810133 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce379738-9b65-47ae-81ee-38c90eaf6a1f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:58.283512 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ce379738-9b65-47ae-81ee-38c90eaf6a1f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:58.293219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ce379738-9b65-47ae-81ee-38c90eaf6a1f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1322 microversion: 2.1 time: 0.514148 Oct 27 17:31:58.299923 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 120/273] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:57 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1322 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:59.316614 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2a7967f5-edeb-411a-ae83-f22efb70faf7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:31:59.317829 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2a7967f5-edeb-411a-ae83-f22efb70faf7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:59.324555 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2a7967f5-edeb-411a-ae83-f22efb70faf7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:59.325089 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2a7967f5-edeb-411a-ae83-f22efb70faf7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:59.325744 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2a7967f5-edeb-411a-ae83-f22efb70faf7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:59.326749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2a7967f5-edeb-411a-ae83-f22efb70faf7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:59.327426 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2a7967f5-edeb-411a-ae83-f22efb70faf7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:59.327968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2a7967f5-edeb-411a-ae83-f22efb70faf7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:59.871507 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2a7967f5-edeb-411a-ae83-f22efb70faf7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:31:59.895651 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2a7967f5-edeb-411a-ae83-f22efb70faf7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1516 microversion: 2.1 time: 0.583653 Oct 27 17:31:59.898110 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 154/274] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:31:59 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1516 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:31:59.927402 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-60eea0ab-136a-41a0-ae80-955be11ffcd2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:31:59.930443 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-60eea0ab-136a-41a0-ae80-955be11ffcd2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:31:59.942249 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60eea0ab-136a-41a0-ae80-955be11ffcd2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:59.942956 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60eea0ab-136a-41a0-ae80-955be11ffcd2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:59.943394 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60eea0ab-136a-41a0-ae80-955be11ffcd2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:31:59.944450 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60eea0ab-136a-41a0-ae80-955be11ffcd2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:31:59.945969 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60eea0ab-136a-41a0-ae80-955be11ffcd2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:31:59.948917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60eea0ab-136a-41a0-ae80-955be11ffcd2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:00.018451 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-60eea0ab-136a-41a0-ae80-955be11ffcd2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lazy-loading 'flavor' on Instance uuid 3c65005a-985e-4fae-a09d-8cfc17bc9e93 {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:32:00.167493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:32:00.302435 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-60eea0ab-136a-41a0-ae80-955be11ffcd2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "POST /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93/action" status: 200 len: 32 microversion: 2.1 time: 0.380903 Oct 27 17:32:00.312915 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 121/275] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Oct 27 17:31:59 2022] POST /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93/action => generated 32 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 17:32:00.315049 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-dce2e4da-b952-4d52-a86b-a9aa76f14ee0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:00.315827 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-dce2e4da-b952-4d52-a86b-a9aa76f14ee0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:00.331351 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dce2e4da-b952-4d52-a86b-a9aa76f14ee0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:00.332081 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dce2e4da-b952-4d52-a86b-a9aa76f14ee0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:00.332480 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dce2e4da-b952-4d52-a86b-a9aa76f14ee0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:00.333267 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dce2e4da-b952-4d52-a86b-a9aa76f14ee0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:00.334085 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dce2e4da-b952-4d52-a86b-a9aa76f14ee0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:00.334956 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dce2e4da-b952-4d52-a86b-a9aa76f14ee0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:00.913802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-dce2e4da-b952-4d52-a86b-a9aa76f14ee0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:00.925266 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-dce2e4da-b952-4d52-a86b-a9aa76f14ee0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.615255 Oct 27 17:32:00.927499 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 155/276] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:00 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:01.960483 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ca0568cb-bafc-432a-8ad9-23d2747b44c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:01.962975 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ca0568cb-bafc-432a-8ad9-23d2747b44c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:01.979662 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ca0568cb-bafc-432a-8ad9-23d2747b44c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:01.980212 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ca0568cb-bafc-432a-8ad9-23d2747b44c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:01.983553 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ca0568cb-bafc-432a-8ad9-23d2747b44c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:01.985423 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ca0568cb-bafc-432a-8ad9-23d2747b44c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:01.988286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ca0568cb-bafc-432a-8ad9-23d2747b44c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:01.988739 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ca0568cb-bafc-432a-8ad9-23d2747b44c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:02.209088 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ca0568cb-bafc-432a-8ad9-23d2747b44c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:02.217464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ca0568cb-bafc-432a-8ad9-23d2747b44c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.263957 Oct 27 17:32:02.235516 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 122/277] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:01 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:03.242753 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-dd8ab8ce-9276-47a3-9db1-79014e8c7c04 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:03.243352 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-dd8ab8ce-9276-47a3-9db1-79014e8c7c04 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:03.250120 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd8ab8ce-9276-47a3-9db1-79014e8c7c04 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:03.250886 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd8ab8ce-9276-47a3-9db1-79014e8c7c04 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:03.251863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd8ab8ce-9276-47a3-9db1-79014e8c7c04 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:03.253294 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd8ab8ce-9276-47a3-9db1-79014e8c7c04 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:03.255822 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd8ab8ce-9276-47a3-9db1-79014e8c7c04 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:03.256581 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd8ab8ce-9276-47a3-9db1-79014e8c7c04 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:03.468808 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-dd8ab8ce-9276-47a3-9db1-79014e8c7c04 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:03.480594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-dd8ab8ce-9276-47a3-9db1-79014e8c7c04 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.240165 Oct 27 17:32:03.483416 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 156/278] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:03 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:04.510625 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-eba6d663-402f-459e-bfc8-77369e9b52df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:04.511236 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-eba6d663-402f-459e-bfc8-77369e9b52df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:04.522363 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eba6d663-402f-459e-bfc8-77369e9b52df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:04.527361 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eba6d663-402f-459e-bfc8-77369e9b52df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:04.527867 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eba6d663-402f-459e-bfc8-77369e9b52df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:04.528591 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eba6d663-402f-459e-bfc8-77369e9b52df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:04.529210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eba6d663-402f-459e-bfc8-77369e9b52df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:04.530254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eba6d663-402f-459e-bfc8-77369e9b52df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:04.782976 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-eba6d663-402f-459e-bfc8-77369e9b52df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:04.791026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-eba6d663-402f-459e-bfc8-77369e9b52df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.285559 Oct 27 17:32:04.791607 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 123/279] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:04 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:05.819350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c608de7a-0ad6-412f-861b-7f786f685419 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:05.821019 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c608de7a-0ad6-412f-861b-7f786f685419 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:05.831312 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c608de7a-0ad6-412f-861b-7f786f685419 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:05.831841 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c608de7a-0ad6-412f-861b-7f786f685419 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:05.832928 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c608de7a-0ad6-412f-861b-7f786f685419 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:05.833809 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c608de7a-0ad6-412f-861b-7f786f685419 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:05.834459 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c608de7a-0ad6-412f-861b-7f786f685419 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:05.835186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c608de7a-0ad6-412f-861b-7f786f685419 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:06.041586 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c608de7a-0ad6-412f-861b-7f786f685419 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:06.055272 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c608de7a-0ad6-412f-861b-7f786f685419 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.241296 Oct 27 17:32:06.057131 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 157/280] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:05 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:07.089364 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-af6bb5d1-3dbc-4151-a343-30f3cf08e2ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:07.091737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-af6bb5d1-3dbc-4151-a343-30f3cf08e2ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:07.101537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-af6bb5d1-3dbc-4151-a343-30f3cf08e2ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:07.102720 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-af6bb5d1-3dbc-4151-a343-30f3cf08e2ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:07.103841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-af6bb5d1-3dbc-4151-a343-30f3cf08e2ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:07.104907 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-af6bb5d1-3dbc-4151-a343-30f3cf08e2ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:07.106656 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-af6bb5d1-3dbc-4151-a343-30f3cf08e2ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:07.107365 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-af6bb5d1-3dbc-4151-a343-30f3cf08e2ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:07.337412 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-af6bb5d1-3dbc-4151-a343-30f3cf08e2ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:07.371554 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-af6bb5d1-3dbc-4151-a343-30f3cf08e2ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.283877 Oct 27 17:32:07.374680 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 124/281] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:07 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:08.401995 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-12a678fe-5bf6-4865-b53f-4dfb307f44d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:08.402610 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-12a678fe-5bf6-4865-b53f-4dfb307f44d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:08.414057 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-12a678fe-5bf6-4865-b53f-4dfb307f44d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:08.414773 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-12a678fe-5bf6-4865-b53f-4dfb307f44d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:08.415458 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-12a678fe-5bf6-4865-b53f-4dfb307f44d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:08.416420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-12a678fe-5bf6-4865-b53f-4dfb307f44d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:08.417408 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-12a678fe-5bf6-4865-b53f-4dfb307f44d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:08.418100 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-12a678fe-5bf6-4865-b53f-4dfb307f44d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:08.607046 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-12a678fe-5bf6-4865-b53f-4dfb307f44d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:08.610795 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=100 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:32:08.617716 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-12a678fe-5bf6-4865-b53f-4dfb307f44d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.220370 Oct 27 17:32:08.619041 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 158/282] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:08 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:08.712887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d1aa4974-5bcb-48a7-b65b-0a824941e72e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:08.715126 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d1aa4974-5bcb-48a7-b65b-0a824941e72e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:08.727229 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d1aa4974-5bcb-48a7-b65b-0a824941e72e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:08.728117 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d1aa4974-5bcb-48a7-b65b-0a824941e72e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:08.730459 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d1aa4974-5bcb-48a7-b65b-0a824941e72e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:08.735934 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d1aa4974-5bcb-48a7-b65b-0a824941e72e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:08.736765 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d1aa4974-5bcb-48a7-b65b-0a824941e72e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:08.737920 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d1aa4974-5bcb-48a7-b65b-0a824941e72e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:08.777062 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d1aa4974-5bcb-48a7-b65b-0a824941e72e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Going to try to terminate instance {{(pid=119046) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:32:09.037374 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d1aa4974-5bcb-48a7-b65b-0a824941e72e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 204 len: 0 microversion: 2.1 time: 0.330433 Oct 27 17:32:09.041390 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 125/283] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:32:08 2022] DELETE /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:32:09.047561 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a5171433-85c9-428b-9f43-0222dc3fca8b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:09.048388 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a5171433-85c9-428b-9f43-0222dc3fca8b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:09.057939 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a5171433-85c9-428b-9f43-0222dc3fca8b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:09.058844 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a5171433-85c9-428b-9f43-0222dc3fca8b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:09.059472 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a5171433-85c9-428b-9f43-0222dc3fca8b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:09.060442 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a5171433-85c9-428b-9f43-0222dc3fca8b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:09.061142 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a5171433-85c9-428b-9f43-0222dc3fca8b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:09.061742 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a5171433-85c9-428b-9f43-0222dc3fca8b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:09.204990 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a5171433-85c9-428b-9f43-0222dc3fca8b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:09.216307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a5171433-85c9-428b-9f43-0222dc3fca8b tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1553 microversion: 2.1 time: 0.172589 Oct 27 17:32:09.216878 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 159/284] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:09 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:09.648881 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7713cf92-5c1f-4d45-9333-4e30ca60f8ff tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:09.649695 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7713cf92-5c1f-4d45-9333-4e30ca60f8ff tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:09.656800 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7713cf92-5c1f-4d45-9333-4e30ca60f8ff tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:09.657831 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7713cf92-5c1f-4d45-9333-4e30ca60f8ff tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:09.658245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7713cf92-5c1f-4d45-9333-4e30ca60f8ff tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:09.659188 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7713cf92-5c1f-4d45-9333-4e30ca60f8ff tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:09.659831 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7713cf92-5c1f-4d45-9333-4e30ca60f8ff tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:09.659963 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7713cf92-5c1f-4d45-9333-4e30ca60f8ff tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:09.806402 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7713cf92-5c1f-4d45-9333-4e30ca60f8ff tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:09.815262 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7713cf92-5c1f-4d45-9333-4e30ca60f8ff tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.170875 Oct 27 17:32:09.815861 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 126/285] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:09 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:10.245908 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1faddd12-5a73-4eaf-bff6-d3e5480b5592 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:10.246712 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-1faddd12-5a73-4eaf-bff6-d3e5480b5592 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:10.254795 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1faddd12-5a73-4eaf-bff6-d3e5480b5592 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:10.256924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1faddd12-5a73-4eaf-bff6-d3e5480b5592 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:10.258486 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1faddd12-5a73-4eaf-bff6-d3e5480b5592 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:10.262142 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1faddd12-5a73-4eaf-bff6-d3e5480b5592 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:10.262841 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1faddd12-5a73-4eaf-bff6-d3e5480b5592 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:10.263581 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1faddd12-5a73-4eaf-bff6-d3e5480b5592 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:10.445072 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1faddd12-5a73-4eaf-bff6-d3e5480b5592 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:10.455744 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1faddd12-5a73-4eaf-bff6-d3e5480b5592 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1553 microversion: 2.1 time: 0.214829 Oct 27 17:32:10.471034 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 160/286] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:10 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1553 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:10.839986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-1f16d392-65ab-4f66-9973-51e2bf5ad87a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:10.840710 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-1f16d392-65ab-4f66-9973-51e2bf5ad87a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:10.850827 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f16d392-65ab-4f66-9973-51e2bf5ad87a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:10.851573 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f16d392-65ab-4f66-9973-51e2bf5ad87a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:10.851924 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f16d392-65ab-4f66-9973-51e2bf5ad87a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:10.858500 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f16d392-65ab-4f66-9973-51e2bf5ad87a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:10.859320 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f16d392-65ab-4f66-9973-51e2bf5ad87a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:10.865714 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f16d392-65ab-4f66-9973-51e2bf5ad87a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:11.104760 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1f16d392-65ab-4f66-9973-51e2bf5ad87a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:11.117786 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-1f16d392-65ab-4f66-9973-51e2bf5ad87a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.281025 Oct 27 17:32:11.132425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 127/287] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:10 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:11.491955 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-327f6327-4cc7-4cac-8ea0-bc598fe741aa tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:11.492931 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-327f6327-4cc7-4cac-8ea0-bc598fe741aa tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:11.504344 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-327f6327-4cc7-4cac-8ea0-bc598fe741aa tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:11.505684 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-327f6327-4cc7-4cac-8ea0-bc598fe741aa tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:11.506327 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-327f6327-4cc7-4cac-8ea0-bc598fe741aa tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:11.507340 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-327f6327-4cc7-4cac-8ea0-bc598fe741aa tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:11.508481 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-327f6327-4cc7-4cac-8ea0-bc598fe741aa tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:11.509917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-327f6327-4cc7-4cac-8ea0-bc598fe741aa tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:11.758050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-327f6327-4cc7-4cac-8ea0-bc598fe741aa tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:11.772368 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-327f6327-4cc7-4cac-8ea0-bc598fe741aa tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1553 microversion: 2.1 time: 0.291129 Oct 27 17:32:11.778211 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 161/288] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:11 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1553 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:12.144039 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-1d2200c7-8175-4ec6-ba7c-ce65b4526045 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:12.145659 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-1d2200c7-8175-4ec6-ba7c-ce65b4526045 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:12.169328 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1d2200c7-8175-4ec6-ba7c-ce65b4526045 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:12.170357 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1d2200c7-8175-4ec6-ba7c-ce65b4526045 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:12.171017 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1d2200c7-8175-4ec6-ba7c-ce65b4526045 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:12.172152 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1d2200c7-8175-4ec6-ba7c-ce65b4526045 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:12.173382 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1d2200c7-8175-4ec6-ba7c-ce65b4526045 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:12.174024 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1d2200c7-8175-4ec6-ba7c-ce65b4526045 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:12.463988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5ec34496-7da0-4cc3-9243-dd28b204ab76 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Action: 'create', calling method: .version_select at 0x7f0788a50430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1372919521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlBcmdsLE53yepsfLQGdTw4SmSeek/pzeXxo95n0ex1wvPpJV54YOAbLt65nnGkP7MVU+1ZFpzmC2LU0vyRtckktNGgz4V1qG5QV+VmvOxGWoAGkuzUI+sCa6mxzGrP+A=="}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:32:12.479703 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-5ec34496-7da0-4cc3-9243-dd28b204ab76 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Getting quotas for project 9dcd831cfdd74db99f8e0b07b84f41d7. Resources: {'key_pairs'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:32:12.484731 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-5ec34496-7da0-4cc3-9243-dd28b204ab76 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Getting quotas for user 930279b9b9b94549b78c62d9f681d198 and project 9dcd831cfdd74db99f8e0b07b84f41d7. Resources: {'key_pairs'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:32:12.497900 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1d2200c7-8175-4ec6-ba7c-ce65b4526045 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:12.506393 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-1d2200c7-8175-4ec6-ba7c-ce65b4526045 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.368130 Oct 27 17:32:12.510416 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 128/289] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:12 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:12.528178 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5ec34496-7da0-4cc3-9243-dd28b204ab76 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.068851 Oct 27 17:32:12.529522 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 162/290] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Oct 27 17:32:12 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:32:12.741591 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-904727669", "imageRef": "4d9c93f9-bf70-44b6-aca0-aa8226fa6fa3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1372919521", "networks": [{"uuid": "30480d51-001d-414c-aae8-f3bdce76bc80"}]}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:32:12.807268 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-e8fe8781-97bc-4b9f-8594-a9a2d0a3c298 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:12.808168 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e8fe8781-97bc-4b9f-8594-a9a2d0a3c298 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:12.808987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.network.neutron [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] validate_networks() for [('30480d51-001d-414c-aae8-f3bdce76bc80', None, None, None, None, None)] {{(pid=119046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:32:12.815907 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e8fe8781-97bc-4b9f-8594-a9a2d0a3c298 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:12.817906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e8fe8781-97bc-4b9f-8594-a9a2d0a3c298 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:12.818355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e8fe8781-97bc-4b9f-8594-a9a2d0a3c298 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:12.819076 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e8fe8781-97bc-4b9f-8594-a9a2d0a3c298 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:12.819537 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e8fe8781-97bc-4b9f-8594-a9a2d0a3c298 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:12.819990 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e8fe8781-97bc-4b9f-8594-a9a2d0a3c298 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:12.952348 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e8fe8781-97bc-4b9f-8594-a9a2d0a3c298 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:12.970371 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-e8fe8781-97bc-4b9f-8594-a9a2d0a3c298 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1511 microversion: 2.1 time: 0.166984 Oct 27 17:32:12.975196 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 163/291] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:12 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:12.984075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-096288df-21f0-441b-b8ca-bd2fa070756e req-f61b5f59-de9b-43c3-943e-dc6f23eddab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6f4324-0826-4b60-b1b5-a7d00c63cdec", "name": "network-vif-deleted", "tag": "dd5472a4-a592-4461-977c-b241c99f30b9"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:32:13.009880 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:32:13.034812 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-096288df-21f0-441b-b8ca-bd2fa070756e req-f61b5f59-de9b-43c3-943e-dc6f23eddab0 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:13.035587 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-096288df-21f0-441b-b8ca-bd2fa070756e req-f61b5f59-de9b-43c3-943e-dc6f23eddab0 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:13.036053 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-096288df-21f0-441b-b8ca-bd2fa070756e req-f61b5f59-de9b-43c3-943e-dc6f23eddab0 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:13.073095 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-096288df-21f0-441b-b8ca-bd2fa070756e req-f61b5f59-de9b-43c3-943e-dc6f23eddab0 service nova] Creating event network-vif-deleted:dd5472a4-a592-4461-977c-b241c99f30b9 for instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec on hv-cinder-86283 Oct 27 17:32:13.088041 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-096288df-21f0-441b-b8ca-bd2fa070756e req-f61b5f59-de9b-43c3-943e-dc6f23eddab0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107647 Oct 27 17:32:13.088675 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 164/292] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:32:13.361874 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Flavor limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:32:13.362446 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Image limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:32:13.362915 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Flavor pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:32:13.363322 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Image pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:32:13.363884 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:32:13.372981 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:13.373696 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:13.374133 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:13.374854 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:13.375304 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:13.375758 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:13.395037 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Getting quotas for project 9dcd831cfdd74db99f8e0b07b84f41d7. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:32:13.399423 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Getting quotas for user 930279b9b9b94549b78c62d9f681d198 and project 9dcd831cfdd74db99f8e0b07b84f41d7. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:32:13.411660 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Going to run 1 instances... {{(pid=119046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:32:13.414294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d9c93f9-bf70-44b6-aca0-aa8226fa6fa3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:32:13.480363 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8b3b4b81-bf21-4c6d-86e3-1298e5e2368e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739627 Oct 27 17:32:13.481052 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 129/293] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:32:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:32:13.505042 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-bc747979-8a73-41af-9ca6-dcc88f9d310e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:13.505790 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-bc747979-8a73-41af-9ca6-dcc88f9d310e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:13.535305 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a4159a28-8a45-44f5-b54b-e68970ba8d46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:13.536646 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a4159a28-8a45-44f5-b54b-e68970ba8d46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:13.552416 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a4159a28-8a45-44f5-b54b-e68970ba8d46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:13.552950 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a4159a28-8a45-44f5-b54b-e68970ba8d46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:13.553396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a4159a28-8a45-44f5-b54b-e68970ba8d46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:13.558608 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a4159a28-8a45-44f5-b54b-e68970ba8d46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:13.559347 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a4159a28-8a45-44f5-b54b-e68970ba8d46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:13.566262 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a4159a28-8a45-44f5-b54b-e68970ba8d46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:13.602037 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-bc747979-8a73-41af-9ca6-dcc88f9d310e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:13.610018 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-bc747979-8a73-41af-9ca6-dcc88f9d310e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1258 microversion: 2.1 time: 0.120804 Oct 27 17:32:13.610684 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 165/294] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:13 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1258 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:13.825696 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a4159a28-8a45-44f5-b54b-e68970ba8d46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:13.834104 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a4159a28-8a45-44f5-b54b-e68970ba8d46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.304023 Oct 27 17:32:13.835286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 130/295] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:13 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:13.996144 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1c7a908a-d1d2-468a-a85a-f5c6b91f7863 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:13.996957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-1c7a908a-d1d2-468a-a85a-f5c6b91f7863 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:14.003651 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1c7a908a-d1d2-468a-a85a-f5c6b91f7863 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:14.005358 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1c7a908a-d1d2-468a-a85a-f5c6b91f7863 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:14.006517 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1c7a908a-d1d2-468a-a85a-f5c6b91f7863 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:14.007221 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1c7a908a-d1d2-468a-a85a-f5c6b91f7863 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:14.007883 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1c7a908a-d1d2-468a-a85a-f5c6b91f7863 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:14.008314 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1c7a908a-d1d2-468a-a85a-f5c6b91f7863 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:14.041247 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1c7a908a-d1d2-468a-a85a-f5c6b91f7863 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:14.041834 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1c7a908a-d1d2-468a-a85a-f5c6b91f7863 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:14.042160 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1c7a908a-d1d2-468a-a85a-f5c6b91f7863 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:14.042767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.objects.instance [None req-1c7a908a-d1d2-468a-a85a-f5c6b91f7863 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lazy-loading 'fault' on Instance uuid 7a6f4324-0826-4b60-b1b5-a7d00c63cdec {{(pid=119047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:32:14.099309 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1c7a908a-d1d2-468a-a85a-f5c6b91f7863 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ef9c40eb5e48fda12aa9e3b420d97e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e47ddf4f9e4e6cb6ed56253f708fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:14.111551 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1c7a908a-d1d2-468a-a85a-f5c6b91f7863 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 200 len: 1350 microversion: 2.1 time: 0.119431 Oct 27 17:32:14.112163 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 166/296] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:13 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 1350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:14.637652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e6f42dc6-0203-43c0-8970-33747e459104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:14.638375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e6f42dc6-0203-43c0-8970-33747e459104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:14.646216 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e6f42dc6-0203-43c0-8970-33747e459104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:14.646698 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e6f42dc6-0203-43c0-8970-33747e459104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:14.647133 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e6f42dc6-0203-43c0-8970-33747e459104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:14.648793 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e6f42dc6-0203-43c0-8970-33747e459104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:14.649281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e6f42dc6-0203-43c0-8970-33747e459104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:14.649715 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e6f42dc6-0203-43c0-8970-33747e459104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:14.724329 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e6f42dc6-0203-43c0-8970-33747e459104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:14.732953 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e6f42dc6-0203-43c0-8970-33747e459104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1310 microversion: 2.1 time: 0.100567 Oct 27 17:32:14.733538 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 131/297] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:14 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1310 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:14.863104 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4c73d932-e1c3-428e-a861-327e1ae9be88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:14.864649 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4c73d932-e1c3-428e-a861-327e1ae9be88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:14.876546 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4c73d932-e1c3-428e-a861-327e1ae9be88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:14.877284 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4c73d932-e1c3-428e-a861-327e1ae9be88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:14.877716 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4c73d932-e1c3-428e-a861-327e1ae9be88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:14.878576 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4c73d932-e1c3-428e-a861-327e1ae9be88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:14.879091 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4c73d932-e1c3-428e-a861-327e1ae9be88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:14.879553 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4c73d932-e1c3-428e-a861-327e1ae9be88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:15.012650 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4c73d932-e1c3-428e-a861-327e1ae9be88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:15.020861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4c73d932-e1c3-428e-a861-327e1ae9be88 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.167111 Oct 27 17:32:15.021424 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 167/298] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:14 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:15.134743 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-634412d4-78ac-4663-98fb-664a29001a62 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:15.135207 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-634412d4-78ac-4663-98fb-664a29001a62 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:15.141186 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-634412d4-78ac-4663-98fb-664a29001a62 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:15.142223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-634412d4-78ac-4663-98fb-664a29001a62 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:15.142664 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-634412d4-78ac-4663-98fb-664a29001a62 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:15.143350 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-634412d4-78ac-4663-98fb-664a29001a62 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:15.143829 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-634412d4-78ac-4663-98fb-664a29001a62 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:15.144255 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-634412d4-78ac-4663-98fb-664a29001a62 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:15.158025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-634412d4-78ac-4663-98fb-664a29001a62 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] HTTP exception thrown: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-634412d4-78ac-4663-98fb-664a29001a62 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Request method failure captured: Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec HTTP/1.1 Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA5EG-QjzlbTZnDunS4dDBJM4CMOmr_GDG3ZWd05aSChFXlTPO5jEKUL3GdGZxXSvvFThCDOk7d5YidGYhkQhH7J49e7ZLamrTMtxP-BovsGCwP8ADV2mYhpOSIlNkj8HwS5Fgkr3k-amXIKZvwVlEPq7tctyWdTJ-MKLxPPj-BibE Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: 32e47ddf4f9e4e6cb6ed56253f708fac Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-DeleteServersTestJSON-133966621 Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:32:15.162575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:32:15.163987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/32e47ddf4f9e4e6cb6ed56253f708fac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32e47ddf4f9e4e6cb6ed56253f708fac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_32e47ddf4f9e4e6cb6ed56253f708fac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32e47ddf4f9e4e6cb6ed56253f708fac"}]}] Oct 27 17:32:15.163987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-DeleteServersTestJSON-133966621 Oct 27 17:32:15.163987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: 32e47ddf4f9e4e6cb6ed56253f708fac Oct 27 17:32:15.163987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-DeleteServersTestJSON-133966621 Oct 27 17:32:15.163987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-DeleteServersTestJSON-133966621-project Oct 27 17:32:15.163987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:32:15.163987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:32:15.163987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 16ef9c40eb5e48fda12aa9e3b420d97e Oct 27 17:32:15.163987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-DeleteServersTestJSON-133966621-project Oct 27 17:32:15.163987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:32:15.163987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:15.163987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '7a6f4324-0826-4b60-b1b5-a7d00c63cdec'} Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:32:15.164719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:15.166109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:32:15.167322 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-634412d4-78ac-4663-98fb-664a29001a62 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Returning 404 to user: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:32:15.167322 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-634412d4-78ac-4663-98fb-664a29001a62 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 404 len: 111 microversion: 2.1 time: 0.033354 Oct 27 17:32:15.167322 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 132/299] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:15 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:32:15.284174 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a548ac32-521f-44ba-8b82-08e641c25f40 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:15.286975 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a548ac32-521f-44ba-8b82-08e641c25f40 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:15.293655 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a548ac32-521f-44ba-8b82-08e641c25f40 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:15.294274 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a548ac32-521f-44ba-8b82-08e641c25f40 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:15.294696 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a548ac32-521f-44ba-8b82-08e641c25f40 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:15.295383 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a548ac32-521f-44ba-8b82-08e641c25f40 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:15.295865 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a548ac32-521f-44ba-8b82-08e641c25f40 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:15.296291 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a548ac32-521f-44ba-8b82-08e641c25f40 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:15.309413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-a548ac32-521f-44ba-8b82-08e641c25f40 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] HTTP exception thrown: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a548ac32-521f-44ba-8b82-08e641c25f40 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Request method failure captured: Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec/os-volume_attachments HTTP/1.1 Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA5EG-QjzlbTZnDunS4dDBJM4CMOmr_GDG3ZWd05aSChFXlTPO5jEKUL3GdGZxXSvvFThCDOk7d5YidGYhkQhH7J49e7ZLamrTMtxP-BovsGCwP8ADV2mYhpOSIlNkj8HwS5Fgkr3k-amXIKZvwVlEPq7tctyWdTJ-MKLxPPj-BibE Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: 32e47ddf4f9e4e6cb6ed56253f708fac Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-DeleteServersTestJSON-133966621 Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:32:15.313968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:32:15.315240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/32e47ddf4f9e4e6cb6ed56253f708fac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32e47ddf4f9e4e6cb6ed56253f708fac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_32e47ddf4f9e4e6cb6ed56253f708fac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32e47ddf4f9e4e6cb6ed56253f708fac"}]}] Oct 27 17:32:15.315240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-DeleteServersTestJSON-133966621 Oct 27 17:32:15.315240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: 32e47ddf4f9e4e6cb6ed56253f708fac Oct 27 17:32:15.315240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-DeleteServersTestJSON-133966621 Oct 27 17:32:15.315240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-DeleteServersTestJSON-133966621-project Oct 27 17:32:15.315240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:32:15.315240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:32:15.315240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 16ef9c40eb5e48fda12aa9e3b420d97e Oct 27 17:32:15.315240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-DeleteServersTestJSON-133966621-project Oct 27 17:32:15.315240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:32:15.315240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:15.315240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'server_id': '7a6f4324-0826-4b60-b1b5-a7d00c63cdec'} Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:32:15.315953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:15.317007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:32:15.318084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a548ac32-521f-44ba-8b82-08e641c25f40 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Returning 404 to user: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:32:15.318084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a548ac32-521f-44ba-8b82-08e641c25f40 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035999 Oct 27 17:32:15.318084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 168/300] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:32:15 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:32:15.757065 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7e55453a-6c2b-4835-9c7a-47d0dcaefae4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:15.757772 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7e55453a-6c2b-4835-9c7a-47d0dcaefae4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:15.764410 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7e55453a-6c2b-4835-9c7a-47d0dcaefae4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:15.764902 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7e55453a-6c2b-4835-9c7a-47d0dcaefae4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:15.766100 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7e55453a-6c2b-4835-9c7a-47d0dcaefae4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:15.766100 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7e55453a-6c2b-4835-9c7a-47d0dcaefae4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:15.767135 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7e55453a-6c2b-4835-9c7a-47d0dcaefae4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:15.767826 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7e55453a-6c2b-4835-9c7a-47d0dcaefae4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:15.841717 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7e55453a-6c2b-4835-9c7a-47d0dcaefae4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:15.849889 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7e55453a-6c2b-4835-9c7a-47d0dcaefae4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1316 microversion: 2.1 time: 0.097036 Oct 27 17:32:15.850453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 133/301] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:15 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1316 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:16.044733 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-38b83aad-744e-4d58-985f-c266ecb5e70e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:16.045347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-38b83aad-744e-4d58-985f-c266ecb5e70e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:16.051870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-38b83aad-744e-4d58-985f-c266ecb5e70e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:16.052358 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-38b83aad-744e-4d58-985f-c266ecb5e70e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:16.052793 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-38b83aad-744e-4d58-985f-c266ecb5e70e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:16.053493 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-38b83aad-744e-4d58-985f-c266ecb5e70e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:16.053949 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-38b83aad-744e-4d58-985f-c266ecb5e70e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:16.054375 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-38b83aad-744e-4d58-985f-c266ecb5e70e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:16.227434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-38b83aad-744e-4d58-985f-c266ecb5e70e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:16.236038 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-38b83aad-744e-4d58-985f-c266ecb5e70e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.195293 Oct 27 17:32:16.253266 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 169/302] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:16 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:16.538079 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e9ae43f0-9961-4ef2-9180-47657dbfb0e7 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:16.538573 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e9ae43f0-9961-4ef2-9180-47657dbfb0e7 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:16.544776 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e9ae43f0-9961-4ef2-9180-47657dbfb0e7 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:16.545255 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e9ae43f0-9961-4ef2-9180-47657dbfb0e7 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:16.545677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e9ae43f0-9961-4ef2-9180-47657dbfb0e7 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:16.546376 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e9ae43f0-9961-4ef2-9180-47657dbfb0e7 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:16.546822 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e9ae43f0-9961-4ef2-9180-47657dbfb0e7 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:16.547236 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e9ae43f0-9961-4ef2-9180-47657dbfb0e7 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:16.561914 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-e9ae43f0-9961-4ef2-9180-47657dbfb0e7 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] HTTP exception thrown: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e9ae43f0-9961-4ef2-9180-47657dbfb0e7 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Request method failure captured: Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: DELETE /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec HTTP/1.1 Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA5EG-QjzlbTZnDunS4dDBJM4CMOmr_GDG3ZWd05aSChFXlTPO5jEKUL3GdGZxXSvvFThCDOk7d5YidGYhkQhH7J49e7ZLamrTMtxP-BovsGCwP8ADV2mYhpOSIlNkj8HwS5Fgkr3k-amXIKZvwVlEPq7tctyWdTJ-MKLxPPj-BibE Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: 32e47ddf4f9e4e6cb6ed56253f708fac Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-DeleteServersTestJSON-133966621 Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:32:16.564401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:32:16.565802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/32e47ddf4f9e4e6cb6ed56253f708fac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32e47ddf4f9e4e6cb6ed56253f708fac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_32e47ddf4f9e4e6cb6ed56253f708fac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32e47ddf4f9e4e6cb6ed56253f708fac"}]}] Oct 27 17:32:16.565802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-DeleteServersTestJSON-133966621 Oct 27 17:32:16.565802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: 32e47ddf4f9e4e6cb6ed56253f708fac Oct 27 17:32:16.565802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-DeleteServersTestJSON-133966621 Oct 27 17:32:16.565802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-DeleteServersTestJSON-133966621-project Oct 27 17:32:16.565802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:32:16.565802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:32:16.565802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 16ef9c40eb5e48fda12aa9e3b420d97e Oct 27 17:32:16.565802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-DeleteServersTestJSON-133966621-project Oct 27 17:32:16.565802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:32:16.565802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:16.565802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '7a6f4324-0826-4b60-b1b5-a7d00c63cdec'} Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:32:16.566460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:16.567616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:32:16.569746 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e9ae43f0-9961-4ef2-9180-47657dbfb0e7 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Returning 404 to user: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:32:16.569746 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e9ae43f0-9961-4ef2-9180-47657dbfb0e7 tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 404 len: 111 microversion: 2.1 time: 0.031606 Oct 27 17:32:16.569746 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 134/303] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:32:16 2022] DELETE /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:32:16.574417 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8154edd3-854c-4361-bda3-86ba2b62729e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:16.575274 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8154edd3-854c-4361-bda3-86ba2b62729e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] [instance: 7a6f4324-0826-4b60-b1b5-a7d00c63cdec] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:16.582551 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8154edd3-854c-4361-bda3-86ba2b62729e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:16.583034 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8154edd3-854c-4361-bda3-86ba2b62729e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:16.583461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8154edd3-854c-4361-bda3-86ba2b62729e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:16.584579 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8154edd3-854c-4361-bda3-86ba2b62729e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:16.584720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8154edd3-854c-4361-bda3-86ba2b62729e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:16.585030 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8154edd3-854c-4361-bda3-86ba2b62729e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:16.600455 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-8154edd3-854c-4361-bda3-86ba2b62729e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] HTTP exception thrown: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8154edd3-854c-4361-bda3-86ba2b62729e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Request method failure captured: Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec HTTP/1.1 Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA5EG-QjzlbTZnDunS4dDBJM4CMOmr_GDG3ZWd05aSChFXlTPO5jEKUL3GdGZxXSvvFThCDOk7d5YidGYhkQhH7J49e7ZLamrTMtxP-BovsGCwP8ADV2mYhpOSIlNkj8HwS5Fgkr3k-amXIKZvwVlEPq7tctyWdTJ-MKLxPPj-BibE Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: 32e47ddf4f9e4e6cb6ed56253f708fac Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-DeleteServersTestJSON-133966621 Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:32:16.602642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:32:16.603861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/32e47ddf4f9e4e6cb6ed56253f708fac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32e47ddf4f9e4e6cb6ed56253f708fac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_32e47ddf4f9e4e6cb6ed56253f708fac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/32e47ddf4f9e4e6cb6ed56253f708fac"}]}] Oct 27 17:32:16.603861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-DeleteServersTestJSON-133966621 Oct 27 17:32:16.603861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: 32e47ddf4f9e4e6cb6ed56253f708fac Oct 27 17:32:16.603861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-DeleteServersTestJSON-133966621 Oct 27 17:32:16.603861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-DeleteServersTestJSON-133966621-project Oct 27 17:32:16.603861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:32:16.603861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:32:16.603861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 16ef9c40eb5e48fda12aa9e3b420d97e Oct 27 17:32:16.603861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-DeleteServersTestJSON-133966621-project Oct 27 17:32:16.603861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:32:16.603861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:16.603861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': '7a6f4324-0826-4b60-b1b5-a7d00c63cdec'} Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:32:16.604520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. Oct 27 17:32:16.605670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:32:16.606944 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8154edd3-854c-4361-bda3-86ba2b62729e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] Returning 404 to user: Instance 7a6f4324-0826-4b60-b1b5-a7d00c63cdec could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:32:16.606944 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8154edd3-854c-4361-bda3-86ba2b62729e tempest-DeleteServersTestJSON-133966621 tempest-DeleteServersTestJSON-133966621-project] 10.222.0.36 "GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec" status: 404 len: 111 microversion: 2.1 time: 0.033530 Oct 27 17:32:16.606944 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 170/304] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:16 2022] GET /compute/v2.1/servers/7a6f4324-0826-4b60-b1b5-a7d00c63cdec => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:32:16.874023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8f161ba0-45fb-4a49-ba25-340364e0a48d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:16.874637 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8f161ba0-45fb-4a49-ba25-340364e0a48d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:16.881345 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8f161ba0-45fb-4a49-ba25-340364e0a48d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:16.881980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8f161ba0-45fb-4a49-ba25-340364e0a48d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:16.882426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8f161ba0-45fb-4a49-ba25-340364e0a48d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:16.883120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8f161ba0-45fb-4a49-ba25-340364e0a48d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:16.883568 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8f161ba0-45fb-4a49-ba25-340364e0a48d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:16.884150 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8f161ba0-45fb-4a49-ba25-340364e0a48d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:17.091608 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8f161ba0-45fb-4a49-ba25-340364e0a48d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:17.099572 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8f161ba0-45fb-4a49-ba25-340364e0a48d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.229551 Oct 27 17:32:17.100734 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 135/305] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:16 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:17.211305 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-e3e99d82-805d-45d0-bd60-77ab7449ef5b req-977fc4f6-776a-46fc-b3f3-717a26259480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95000566-a99d-4dc8-b509-bc86de3e8743", "tag": "e5243648-b4fa-47b1-96eb-9bf82da1c364"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:32:17.221906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-e3e99d82-805d-45d0-bd60-77ab7449ef5b req-977fc4f6-776a-46fc-b3f3-717a26259480 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:17.222926 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-e3e99d82-805d-45d0-bd60-77ab7449ef5b req-977fc4f6-776a-46fc-b3f3-717a26259480 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:17.223504 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-e3e99d82-805d-45d0-bd60-77ab7449ef5b req-977fc4f6-776a-46fc-b3f3-717a26259480 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:17.241252 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-e3e99d82-805d-45d0-bd60-77ab7449ef5b req-977fc4f6-776a-46fc-b3f3-717a26259480 service nova] Creating event network-changed:e5243648-b4fa-47b1-96eb-9bf82da1c364 for instance 95000566-a99d-4dc8-b509-bc86de3e8743 on hv-cinder-86283 Oct 27 17:32:17.247728 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-e3e99d82-805d-45d0-bd60-77ab7449ef5b req-977fc4f6-776a-46fc-b3f3-717a26259480 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039084 Oct 27 17:32:17.247728 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 171/306] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:32:17.263207 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0940a612-32c8-4b9b-b737-a79cb726d5ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:17.263861 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-0940a612-32c8-4b9b-b737-a79cb726d5ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:17.273337 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0940a612-32c8-4b9b-b737-a79cb726d5ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:17.273895 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0940a612-32c8-4b9b-b737-a79cb726d5ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:17.274424 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0940a612-32c8-4b9b-b737-a79cb726d5ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:17.275081 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0940a612-32c8-4b9b-b737-a79cb726d5ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:17.276230 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0940a612-32c8-4b9b-b737-a79cb726d5ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:17.276660 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0940a612-32c8-4b9b-b737-a79cb726d5ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:17.518934 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0940a612-32c8-4b9b-b737-a79cb726d5ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:17.522480 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:32:17.527951 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0940a612-32c8-4b9b-b737-a79cb726d5ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.273442 Oct 27 17:32:17.528603 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 136/307] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:17 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:18.124073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-18ad9255-7597-4c5d-8306-f2ab55189bab tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:18.125109 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-18ad9255-7597-4c5d-8306-f2ab55189bab tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:18.132387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18ad9255-7597-4c5d-8306-f2ab55189bab tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:18.133183 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18ad9255-7597-4c5d-8306-f2ab55189bab tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:18.133849 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18ad9255-7597-4c5d-8306-f2ab55189bab tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:18.134748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18ad9255-7597-4c5d-8306-f2ab55189bab tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:18.135399 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18ad9255-7597-4c5d-8306-f2ab55189bab tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:18.136052 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18ad9255-7597-4c5d-8306-f2ab55189bab tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:18.383819 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-18ad9255-7597-4c5d-8306-f2ab55189bab tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:18.394381 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-18ad9255-7597-4c5d-8306-f2ab55189bab tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.274405 Oct 27 17:32:18.398401 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 172/308] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:18 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:18.552607 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-341d69f1-ad61-4382-a161-5c68565ab5b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:18.554201 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-341d69f1-ad61-4382-a161-5c68565ab5b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:18.558973 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:32:18.564891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-341d69f1-ad61-4382-a161-5c68565ab5b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:18.565554 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-341d69f1-ad61-4382-a161-5c68565ab5b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:18.566147 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-341d69f1-ad61-4382-a161-5c68565ab5b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:18.566997 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-341d69f1-ad61-4382-a161-5c68565ab5b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:18.567594 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-341d69f1-ad61-4382-a161-5c68565ab5b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:18.568246 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-341d69f1-ad61-4382-a161-5c68565ab5b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:18.754672 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-341d69f1-ad61-4382-a161-5c68565ab5b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:18.765647 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-341d69f1-ad61-4382-a161-5c68565ab5b9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.218435 Oct 27 17:32:18.767380 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 137/309] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:18 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:19.429854 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-440fd3cf-1dcd-46ce-9061-c4b1775e6f62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:19.431109 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-440fd3cf-1dcd-46ce-9061-c4b1775e6f62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:19.439395 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-440fd3cf-1dcd-46ce-9061-c4b1775e6f62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:19.440208 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-440fd3cf-1dcd-46ce-9061-c4b1775e6f62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:19.440865 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-440fd3cf-1dcd-46ce-9061-c4b1775e6f62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:19.441832 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-440fd3cf-1dcd-46ce-9061-c4b1775e6f62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:19.442483 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-440fd3cf-1dcd-46ce-9061-c4b1775e6f62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:19.443105 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-440fd3cf-1dcd-46ce-9061-c4b1775e6f62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:19.693836 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-440fd3cf-1dcd-46ce-9061-c4b1775e6f62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:19.701900 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-440fd3cf-1dcd-46ce-9061-c4b1775e6f62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.277052 Oct 27 17:32:19.702525 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 173/310] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:19 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:19.793172 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b98a304d-2914-4940-b0ba-00a10b120ce7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:19.793870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b98a304d-2914-4940-b0ba-00a10b120ce7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:19.806154 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b98a304d-2914-4940-b0ba-00a10b120ce7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:19.806638 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b98a304d-2914-4940-b0ba-00a10b120ce7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:19.807073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b98a304d-2914-4940-b0ba-00a10b120ce7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:19.807786 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b98a304d-2914-4940-b0ba-00a10b120ce7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:19.808379 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b98a304d-2914-4940-b0ba-00a10b120ce7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:19.808797 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b98a304d-2914-4940-b0ba-00a10b120ce7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:19.979443 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b98a304d-2914-4940-b0ba-00a10b120ce7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:19.988395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b98a304d-2914-4940-b0ba-00a10b120ce7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.202389 Oct 27 17:32:19.989128 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 138/311] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:19 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:20.725865 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8a6d4e3c-3d5d-4af6-839a-829bbec96ba7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:20.726484 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8a6d4e3c-3d5d-4af6-839a-829bbec96ba7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:20.733244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a6d4e3c-3d5d-4af6-839a-829bbec96ba7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:20.733737 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a6d4e3c-3d5d-4af6-839a-829bbec96ba7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:20.734170 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a6d4e3c-3d5d-4af6-839a-829bbec96ba7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:20.734889 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a6d4e3c-3d5d-4af6-839a-829bbec96ba7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:20.735320 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a6d4e3c-3d5d-4af6-839a-829bbec96ba7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:20.735760 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a6d4e3c-3d5d-4af6-839a-829bbec96ba7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:21.013006 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9e9f55a7-1977-495d-8d76-dec037f3ad94 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:21.013829 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9e9f55a7-1977-495d-8d76-dec037f3ad94 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:21.020983 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e9f55a7-1977-495d-8d76-dec037f3ad94 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:21.021606 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e9f55a7-1977-495d-8d76-dec037f3ad94 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:21.022038 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e9f55a7-1977-495d-8d76-dec037f3ad94 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:21.022737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e9f55a7-1977-495d-8d76-dec037f3ad94 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:21.023181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e9f55a7-1977-495d-8d76-dec037f3ad94 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:21.023600 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e9f55a7-1977-495d-8d76-dec037f3ad94 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:21.096259 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8a6d4e3c-3d5d-4af6-839a-829bbec96ba7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:21.104719 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8a6d4e3c-3d5d-4af6-839a-829bbec96ba7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.382723 Oct 27 17:32:21.105483 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 174/312] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:20 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:21.167456 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9e9f55a7-1977-495d-8d76-dec037f3ad94 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:21.176527 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9e9f55a7-1977-495d-8d76-dec037f3ad94 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.168505 Oct 27 17:32:21.177093 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 139/313] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:21 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:22.127604 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c862eb11-2041-4994-ac0b-c4a45624323d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:22.128245 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c862eb11-2041-4994-ac0b-c4a45624323d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:22.134394 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c862eb11-2041-4994-ac0b-c4a45624323d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:22.134874 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c862eb11-2041-4994-ac0b-c4a45624323d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:22.135312 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c862eb11-2041-4994-ac0b-c4a45624323d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:22.136081 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c862eb11-2041-4994-ac0b-c4a45624323d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:22.136730 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c862eb11-2041-4994-ac0b-c4a45624323d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:22.137153 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c862eb11-2041-4994-ac0b-c4a45624323d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:22.201184 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a159bdd6-f478-4d68-a5b5-9e51471c6571 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:22.202393 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a159bdd6-f478-4d68-a5b5-9e51471c6571 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:22.209757 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a159bdd6-f478-4d68-a5b5-9e51471c6571 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:22.210245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a159bdd6-f478-4d68-a5b5-9e51471c6571 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:22.210680 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a159bdd6-f478-4d68-a5b5-9e51471c6571 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:22.212012 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a159bdd6-f478-4d68-a5b5-9e51471c6571 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:22.212627 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a159bdd6-f478-4d68-a5b5-9e51471c6571 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:22.213060 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a159bdd6-f478-4d68-a5b5-9e51471c6571 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:22.318083 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c862eb11-2041-4994-ac0b-c4a45624323d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:22.328755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c862eb11-2041-4994-ac0b-c4a45624323d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.204939 Oct 27 17:32:22.329050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 175/314] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:22 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:22.392168 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a159bdd6-f478-4d68-a5b5-9e51471c6571 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:22.400452 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a159bdd6-f478-4d68-a5b5-9e51471c6571 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.203569 Oct 27 17:32:22.401035 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 140/315] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:22 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:23.351520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-74d44359-2bf7-4704-b52e-873fb829b73c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:23.352146 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-74d44359-2bf7-4704-b52e-873fb829b73c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:23.360239 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74d44359-2bf7-4704-b52e-873fb829b73c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:23.360239 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74d44359-2bf7-4704-b52e-873fb829b73c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:23.360239 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74d44359-2bf7-4704-b52e-873fb829b73c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:23.360659 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74d44359-2bf7-4704-b52e-873fb829b73c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:23.360776 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74d44359-2bf7-4704-b52e-873fb829b73c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:23.361246 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74d44359-2bf7-4704-b52e-873fb829b73c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:23.422830 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-027e3499-65c3-4b19-93ac-01ffac14a7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:23.424217 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-027e3499-65c3-4b19-93ac-01ffac14a7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:23.428567 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=2 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:32:23.429254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=6 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:32:23.433911 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-027e3499-65c3-4b19-93ac-01ffac14a7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:23.434397 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-027e3499-65c3-4b19-93ac-01ffac14a7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:23.434938 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-027e3499-65c3-4b19-93ac-01ffac14a7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:23.435693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-027e3499-65c3-4b19-93ac-01ffac14a7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:23.436295 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-027e3499-65c3-4b19-93ac-01ffac14a7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:23.436836 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-027e3499-65c3-4b19-93ac-01ffac14a7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:23.502533 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-74d44359-2bf7-4704-b52e-873fb829b73c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:23.510333 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-74d44359-2bf7-4704-b52e-873fb829b73c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.162766 Oct 27 17:32:23.510902 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 176/316] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:23 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:23.576138 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-027e3499-65c3-4b19-93ac-01ffac14a7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:23.585859 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-027e3499-65c3-4b19-93ac-01ffac14a7d6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.166937 Oct 27 17:32:23.586436 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 141/317] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:23 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:24.533965 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-684b5a36-d3fb-4d23-a06b-fe6cd0c96ee9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:24.534599 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-684b5a36-d3fb-4d23-a06b-fe6cd0c96ee9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:24.536594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=6 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:32:24.542066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-684b5a36-d3fb-4d23-a06b-fe6cd0c96ee9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:24.542490 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-684b5a36-d3fb-4d23-a06b-fe6cd0c96ee9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:24.542919 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-684b5a36-d3fb-4d23-a06b-fe6cd0c96ee9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:24.543606 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-684b5a36-d3fb-4d23-a06b-fe6cd0c96ee9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:24.544086 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-684b5a36-d3fb-4d23-a06b-fe6cd0c96ee9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:24.544511 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-684b5a36-d3fb-4d23-a06b-fe6cd0c96ee9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:24.609356 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e4262108-1b7d-462a-bab4-061db4bed876 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:24.610522 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e4262108-1b7d-462a-bab4-061db4bed876 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:24.617800 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e4262108-1b7d-462a-bab4-061db4bed876 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:24.618299 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e4262108-1b7d-462a-bab4-061db4bed876 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:24.618725 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e4262108-1b7d-462a-bab4-061db4bed876 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:24.619428 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e4262108-1b7d-462a-bab4-061db4bed876 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:24.619910 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e4262108-1b7d-462a-bab4-061db4bed876 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:24.620339 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e4262108-1b7d-462a-bab4-061db4bed876 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:24.678713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-684b5a36-d3fb-4d23-a06b-fe6cd0c96ee9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:24.686326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-684b5a36-d3fb-4d23-a06b-fe6cd0c96ee9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.156308 Oct 27 17:32:24.686920 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 177/318] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:24 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:24.752271 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e4262108-1b7d-462a-bab4-061db4bed876 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:24.760697 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e4262108-1b7d-462a-bab4-061db4bed876 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.155414 Oct 27 17:32:24.761361 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 142/319] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:24 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:25.709892 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-3c39865f-06f0-4b6f-a43c-d208f3d65c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:25.710603 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-3c39865f-06f0-4b6f-a43c-d208f3d65c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:25.716519 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c39865f-06f0-4b6f-a43c-d208f3d65c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:25.717002 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c39865f-06f0-4b6f-a43c-d208f3d65c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:25.717427 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c39865f-06f0-4b6f-a43c-d208f3d65c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:25.718102 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c39865f-06f0-4b6f-a43c-d208f3d65c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:25.718545 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c39865f-06f0-4b6f-a43c-d208f3d65c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:25.718959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c39865f-06f0-4b6f-a43c-d208f3d65c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:25.784333 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-22c17f45-526d-4549-9d94-d6700f51f1a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:25.784997 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-22c17f45-526d-4549-9d94-d6700f51f1a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:25.791501 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-22c17f45-526d-4549-9d94-d6700f51f1a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:25.791972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-22c17f45-526d-4549-9d94-d6700f51f1a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:25.792434 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-22c17f45-526d-4549-9d94-d6700f51f1a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:25.793123 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-22c17f45-526d-4549-9d94-d6700f51f1a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:25.793778 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-22c17f45-526d-4549-9d94-d6700f51f1a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:25.794200 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-22c17f45-526d-4549-9d94-d6700f51f1a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:25.868107 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-3c39865f-06f0-4b6f-a43c-d208f3d65c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:25.875808 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-3c39865f-06f0-4b6f-a43c-d208f3d65c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.169803 Oct 27 17:32:25.876372 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 178/320] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:25 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:25.941001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-22c17f45-526d-4549-9d94-d6700f51f1a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:25.948724 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-22c17f45-526d-4549-9d94-d6700f51f1a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.168827 Oct 27 17:32:25.949463 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 143/321] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:25 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:26.898258 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-767a6f0e-779d-4b3d-83f2-42d98689d929 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:26.898998 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-767a6f0e-779d-4b3d-83f2-42d98689d929 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:26.905579 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-767a6f0e-779d-4b3d-83f2-42d98689d929 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:26.906067 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-767a6f0e-779d-4b3d-83f2-42d98689d929 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:26.906501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-767a6f0e-779d-4b3d-83f2-42d98689d929 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:26.907225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-767a6f0e-779d-4b3d-83f2-42d98689d929 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:26.907678 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-767a6f0e-779d-4b3d-83f2-42d98689d929 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:26.908129 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-767a6f0e-779d-4b3d-83f2-42d98689d929 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:26.973423 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-724cdea0-4a5e-47b4-9c37-af1f738d9818 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:26.974034 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-724cdea0-4a5e-47b4-9c37-af1f738d9818 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:26.980557 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-724cdea0-4a5e-47b4-9c37-af1f738d9818 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:26.981299 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-724cdea0-4a5e-47b4-9c37-af1f738d9818 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:26.981738 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-724cdea0-4a5e-47b4-9c37-af1f738d9818 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:26.982421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-724cdea0-4a5e-47b4-9c37-af1f738d9818 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:26.982864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-724cdea0-4a5e-47b4-9c37-af1f738d9818 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:26.983278 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-724cdea0-4a5e-47b4-9c37-af1f738d9818 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:27.039185 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-767a6f0e-779d-4b3d-83f2-42d98689d929 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:27.042654 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=100 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:32:27.047950 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-767a6f0e-779d-4b3d-83f2-42d98689d929 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.153483 Oct 27 17:32:27.048522 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 179/322] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:26 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:27.118498 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-724cdea0-4a5e-47b4-9c37-af1f738d9818 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:27.126293 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-724cdea0-4a5e-47b4-9c37-af1f738d9818 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.157523 Oct 27 17:32:27.126866 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 144/323] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:26 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:28.071362 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2fde621e-efb3-4557-a6e9-753b46abbd5c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:28.071999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2fde621e-efb3-4557-a6e9-753b46abbd5c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:28.078333 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2fde621e-efb3-4557-a6e9-753b46abbd5c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:28.079384 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2fde621e-efb3-4557-a6e9-753b46abbd5c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:28.079852 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2fde621e-efb3-4557-a6e9-753b46abbd5c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:28.080578 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2fde621e-efb3-4557-a6e9-753b46abbd5c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:28.081034 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2fde621e-efb3-4557-a6e9-753b46abbd5c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:28.081457 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2fde621e-efb3-4557-a6e9-753b46abbd5c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:28.148884 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-470612c7-c776-41c2-b447-cff1bfabbbf2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:28.149687 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-470612c7-c776-41c2-b447-cff1bfabbbf2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:28.156208 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-470612c7-c776-41c2-b447-cff1bfabbbf2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:28.156697 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-470612c7-c776-41c2-b447-cff1bfabbbf2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:28.157188 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-470612c7-c776-41c2-b447-cff1bfabbbf2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:28.157937 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-470612c7-c776-41c2-b447-cff1bfabbbf2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:28.158451 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-470612c7-c776-41c2-b447-cff1bfabbbf2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:28.159008 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-470612c7-c776-41c2-b447-cff1bfabbbf2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:28.217404 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2fde621e-efb3-4557-a6e9-753b46abbd5c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:28.225295 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2fde621e-efb3-4557-a6e9-753b46abbd5c tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.157820 Oct 27 17:32:28.225873 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 180/324] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:28 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:28.291474 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-470612c7-c776-41c2-b447-cff1bfabbbf2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:28.299358 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-470612c7-c776-41c2-b447-cff1bfabbbf2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.154425 Oct 27 17:32:28.299978 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 145/325] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:28 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:29.249840 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b2c864fb-3f2f-447a-bf46-345bda53b2df tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:29.251107 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b2c864fb-3f2f-447a-bf46-345bda53b2df tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:29.257161 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2c864fb-3f2f-447a-bf46-345bda53b2df tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:29.257621 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2c864fb-3f2f-447a-bf46-345bda53b2df tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:29.258059 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2c864fb-3f2f-447a-bf46-345bda53b2df tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:29.258954 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2c864fb-3f2f-447a-bf46-345bda53b2df tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:29.259478 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2c864fb-3f2f-447a-bf46-345bda53b2df tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:29.260028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b2c864fb-3f2f-447a-bf46-345bda53b2df tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:29.323178 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4d65b085-36d5-4d1b-aaa9-2f02e0e0872c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:29.324033 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4d65b085-36d5-4d1b-aaa9-2f02e0e0872c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:29.331111 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4d65b085-36d5-4d1b-aaa9-2f02e0e0872c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:29.331596 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4d65b085-36d5-4d1b-aaa9-2f02e0e0872c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:29.332076 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4d65b085-36d5-4d1b-aaa9-2f02e0e0872c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:29.332781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4d65b085-36d5-4d1b-aaa9-2f02e0e0872c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:29.333255 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4d65b085-36d5-4d1b-aaa9-2f02e0e0872c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:29.333710 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4d65b085-36d5-4d1b-aaa9-2f02e0e0872c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:29.400799 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-b2c864fb-3f2f-447a-bf46-345bda53b2df tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:29.409301 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b2c864fb-3f2f-447a-bf46-345bda53b2df tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.163276 Oct 27 17:32:29.409876 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 181/326] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:29 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:29.473056 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4d65b085-36d5-4d1b-aaa9-2f02e0e0872c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:29.481962 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4d65b085-36d5-4d1b-aaa9-2f02e0e0872c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.163043 Oct 27 17:32:29.482538 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 146/327] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:29 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:30.432657 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-38559092-87ec-4480-9541-8662e8b12973 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:30.433266 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-38559092-87ec-4480-9541-8662e8b12973 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:30.439182 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-38559092-87ec-4480-9541-8662e8b12973 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:30.439654 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-38559092-87ec-4480-9541-8662e8b12973 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:30.440108 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-38559092-87ec-4480-9541-8662e8b12973 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:30.440780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-38559092-87ec-4480-9541-8662e8b12973 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:30.441225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-38559092-87ec-4480-9541-8662e8b12973 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:30.441640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-38559092-87ec-4480-9541-8662e8b12973 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:30.509379 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-52f89385-4bd7-4473-9ef8-e4eb32e10deb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:30.510466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-52f89385-4bd7-4473-9ef8-e4eb32e10deb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:30.521899 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-52f89385-4bd7-4473-9ef8-e4eb32e10deb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:30.522730 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-52f89385-4bd7-4473-9ef8-e4eb32e10deb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:30.523512 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-52f89385-4bd7-4473-9ef8-e4eb32e10deb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:30.524937 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-52f89385-4bd7-4473-9ef8-e4eb32e10deb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:30.525616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-52f89385-4bd7-4473-9ef8-e4eb32e10deb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:30.526390 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-52f89385-4bd7-4473-9ef8-e4eb32e10deb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:30.586032 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-38559092-87ec-4480-9541-8662e8b12973 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:30.595034 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-38559092-87ec-4480-9541-8662e8b12973 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.166200 Oct 27 17:32:30.599550 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 182/328] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:30 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:30.662617 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-52f89385-4bd7-4473-9ef8-e4eb32e10deb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:30.670338 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-52f89385-4bd7-4473-9ef8-e4eb32e10deb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.167684 Oct 27 17:32:30.670905 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 147/329] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:30 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:31.618153 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-bec9ee12-684c-4570-b2f0-005a7db03736 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:31.618878 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-bec9ee12-684c-4570-b2f0-005a7db03736 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:31.625546 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bec9ee12-684c-4570-b2f0-005a7db03736 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:31.626024 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bec9ee12-684c-4570-b2f0-005a7db03736 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:31.626482 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bec9ee12-684c-4570-b2f0-005a7db03736 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:31.627167 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bec9ee12-684c-4570-b2f0-005a7db03736 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:31.627614 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bec9ee12-684c-4570-b2f0-005a7db03736 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:31.628058 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bec9ee12-684c-4570-b2f0-005a7db03736 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:31.692409 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2edb0213-c52c-42ce-94b2-ddec3fea4e41 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:31.693015 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2edb0213-c52c-42ce-94b2-ddec3fea4e41 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:31.699308 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2edb0213-c52c-42ce-94b2-ddec3fea4e41 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:31.699814 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2edb0213-c52c-42ce-94b2-ddec3fea4e41 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:31.700244 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2edb0213-c52c-42ce-94b2-ddec3fea4e41 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:31.700932 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2edb0213-c52c-42ce-94b2-ddec3fea4e41 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:31.701561 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2edb0213-c52c-42ce-94b2-ddec3fea4e41 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:31.701982 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2edb0213-c52c-42ce-94b2-ddec3fea4e41 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:31.758031 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-bec9ee12-684c-4570-b2f0-005a7db03736 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:31.765633 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-bec9ee12-684c-4570-b2f0-005a7db03736 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.151402 Oct 27 17:32:31.766751 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 183/330] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:31 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:31.830801 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2edb0213-c52c-42ce-94b2-ddec3fea4e41 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:31.838734 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2edb0213-c52c-42ce-94b2-ddec3fea4e41 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.150167 Oct 27 17:32:31.839301 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 148/331] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:31 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:32.789165 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ef62b389-5252-4e34-bfe8-4bfd25c9ed95 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:32.789774 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-ef62b389-5252-4e34-bfe8-4bfd25c9ed95 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:32.795687 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ef62b389-5252-4e34-bfe8-4bfd25c9ed95 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:32.796185 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ef62b389-5252-4e34-bfe8-4bfd25c9ed95 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:32.796614 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ef62b389-5252-4e34-bfe8-4bfd25c9ed95 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:32.797284 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ef62b389-5252-4e34-bfe8-4bfd25c9ed95 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:32.797725 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ef62b389-5252-4e34-bfe8-4bfd25c9ed95 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:32.798138 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ef62b389-5252-4e34-bfe8-4bfd25c9ed95 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:32.861833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-c96b0c1b-e88f-4ca0-aa49-6c00caa14d3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:32.862439 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c96b0c1b-e88f-4ca0-aa49-6c00caa14d3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:32.869193 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c96b0c1b-e88f-4ca0-aa49-6c00caa14d3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:32.869679 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c96b0c1b-e88f-4ca0-aa49-6c00caa14d3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:32.870230 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c96b0c1b-e88f-4ca0-aa49-6c00caa14d3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:32.870791 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c96b0c1b-e88f-4ca0-aa49-6c00caa14d3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:32.871238 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c96b0c1b-e88f-4ca0-aa49-6c00caa14d3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:32.871663 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c96b0c1b-e88f-4ca0-aa49-6c00caa14d3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:32.936997 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ef62b389-5252-4e34-bfe8-4bfd25c9ed95 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:32.944884 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-ef62b389-5252-4e34-bfe8-4bfd25c9ed95 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.159560 Oct 27 17:32:32.945443 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 184/332] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:32 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:33.011473 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-c96b0c1b-e88f-4ca0-aa49-6c00caa14d3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:33.019614 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-c96b0c1b-e88f-4ca0-aa49-6c00caa14d3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.162116 Oct 27 17:32:33.020212 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 149/333] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:32 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:33.967967 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-cf91e72e-a566-4de8-b640-bb8fa8947ac9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:33.969097 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-cf91e72e-a566-4de8-b640-bb8fa8947ac9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:33.975097 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cf91e72e-a566-4de8-b640-bb8fa8947ac9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:33.975579 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cf91e72e-a566-4de8-b640-bb8fa8947ac9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:33.976050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cf91e72e-a566-4de8-b640-bb8fa8947ac9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:33.976735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cf91e72e-a566-4de8-b640-bb8fa8947ac9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:33.977189 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cf91e72e-a566-4de8-b640-bb8fa8947ac9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:33.977613 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cf91e72e-a566-4de8-b640-bb8fa8947ac9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:34.042521 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9f2ce967-fdee-40c1-89f1-0b70026f7890 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:34.043127 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9f2ce967-fdee-40c1-89f1-0b70026f7890 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:34.050458 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f2ce967-fdee-40c1-89f1-0b70026f7890 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:34.050942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f2ce967-fdee-40c1-89f1-0b70026f7890 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:34.051370 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f2ce967-fdee-40c1-89f1-0b70026f7890 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:34.052246 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f2ce967-fdee-40c1-89f1-0b70026f7890 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:34.052511 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f2ce967-fdee-40c1-89f1-0b70026f7890 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:34.052926 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f2ce967-fdee-40c1-89f1-0b70026f7890 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:34.106439 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-cf91e72e-a566-4de8-b640-bb8fa8947ac9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:34.114803 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-cf91e72e-a566-4de8-b640-bb8fa8947ac9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.150722 Oct 27 17:32:34.115369 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 185/334] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:33 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:34.180964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9f2ce967-fdee-40c1-89f1-0b70026f7890 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:34.188566 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9f2ce967-fdee-40c1-89f1-0b70026f7890 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.150013 Oct 27 17:32:34.189128 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 150/335] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:34 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:35.137500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-83262162-d3f7-4c26-8880-f8131f161506 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:35.138232 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-83262162-d3f7-4c26-8880-f8131f161506 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:35.144792 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83262162-d3f7-4c26-8880-f8131f161506 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:35.145373 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83262162-d3f7-4c26-8880-f8131f161506 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:35.145815 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83262162-d3f7-4c26-8880-f8131f161506 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:35.146504 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83262162-d3f7-4c26-8880-f8131f161506 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:35.146957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83262162-d3f7-4c26-8880-f8131f161506 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:35.147381 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83262162-d3f7-4c26-8880-f8131f161506 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:35.210262 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-50aed866-98f9-4038-9f66-38afc2e1fe95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:35.210965 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-50aed866-98f9-4038-9f66-38afc2e1fe95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:35.217349 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-50aed866-98f9-4038-9f66-38afc2e1fe95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:35.217894 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-50aed866-98f9-4038-9f66-38afc2e1fe95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:35.218250 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-50aed866-98f9-4038-9f66-38afc2e1fe95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:35.219502 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-50aed866-98f9-4038-9f66-38afc2e1fe95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:35.219993 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-50aed866-98f9-4038-9f66-38afc2e1fe95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:35.220404 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-50aed866-98f9-4038-9f66-38afc2e1fe95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:35.284817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-83262162-d3f7-4c26-8880-f8131f161506 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:35.295645 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-83262162-d3f7-4c26-8880-f8131f161506 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.161869 Oct 27 17:32:35.296801 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 186/336] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:35 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:35.444514 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-50aed866-98f9-4038-9f66-38afc2e1fe95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:35.454805 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-50aed866-98f9-4038-9f66-38afc2e1fe95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.247677 Oct 27 17:32:35.455376 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 151/337] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:35 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:36.320227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-710c8ec5-eeac-4add-b95a-6cc851c25b3b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:36.320840 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-710c8ec5-eeac-4add-b95a-6cc851c25b3b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:36.327513 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-710c8ec5-eeac-4add-b95a-6cc851c25b3b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:36.328062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-710c8ec5-eeac-4add-b95a-6cc851c25b3b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:36.328619 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-710c8ec5-eeac-4add-b95a-6cc851c25b3b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:36.329315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-710c8ec5-eeac-4add-b95a-6cc851c25b3b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:36.329878 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-710c8ec5-eeac-4add-b95a-6cc851c25b3b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:36.330226 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-710c8ec5-eeac-4add-b95a-6cc851c25b3b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:36.480539 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-50f07092-d4c6-4ff8-afab-f88f224bc620 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:36.482116 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-50f07092-d4c6-4ff8-afab-f88f224bc620 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:36.483514 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-710c8ec5-eeac-4add-b95a-6cc851c25b3b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:36.491033 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-50f07092-d4c6-4ff8-afab-f88f224bc620 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:36.491893 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-50f07092-d4c6-4ff8-afab-f88f224bc620 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:36.492479 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-50f07092-d4c6-4ff8-afab-f88f224bc620 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:36.493457 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-50f07092-d4c6-4ff8-afab-f88f224bc620 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:36.494229 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-710c8ec5-eeac-4add-b95a-6cc851c25b3b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.177586 Oct 27 17:32:36.494403 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-50f07092-d4c6-4ff8-afab-f88f224bc620 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:36.494818 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 187/338] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:36 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:36.494973 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-50f07092-d4c6-4ff8-afab-f88f224bc620 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:36.639839 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-50f07092-d4c6-4ff8-afab-f88f224bc620 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:36.647939 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-50f07092-d4c6-4ff8-afab-f88f224bc620 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.171590 Oct 27 17:32:36.648788 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 152/339] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:36 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:37.518783 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ccfa3598-2b0c-4f0c-9ce6-7118b102ea45 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:37.519521 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-ccfa3598-2b0c-4f0c-9ce6-7118b102ea45 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:37.532323 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ccfa3598-2b0c-4f0c-9ce6-7118b102ea45 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:37.533003 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ccfa3598-2b0c-4f0c-9ce6-7118b102ea45 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:37.533596 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ccfa3598-2b0c-4f0c-9ce6-7118b102ea45 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:37.534304 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ccfa3598-2b0c-4f0c-9ce6-7118b102ea45 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:37.534759 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ccfa3598-2b0c-4f0c-9ce6-7118b102ea45 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:37.535178 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ccfa3598-2b0c-4f0c-9ce6-7118b102ea45 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:37.671384 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3b294bde-be10-4bf6-87a5-f50340ed474c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:37.672185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-3b294bde-be10-4bf6-87a5-f50340ed474c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:37.678833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3b294bde-be10-4bf6-87a5-f50340ed474c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:37.679311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3b294bde-be10-4bf6-87a5-f50340ed474c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:37.679756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3b294bde-be10-4bf6-87a5-f50340ed474c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:37.680437 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3b294bde-be10-4bf6-87a5-f50340ed474c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:37.680879 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3b294bde-be10-4bf6-87a5-f50340ed474c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:37.681294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3b294bde-be10-4bf6-87a5-f50340ed474c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:37.693154 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ccfa3598-2b0c-4f0c-9ce6-7118b102ea45 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:37.702389 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=100 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:32:37.704376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-ccfa3598-2b0c-4f0c-9ce6-7118b102ea45 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.188227 Oct 27 17:32:37.719354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 188/340] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:37 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:37.840731 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-3b294bde-be10-4bf6-87a5-f50340ed474c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:37.850184 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-3b294bde-be10-4bf6-87a5-f50340ed474c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.182993 Oct 27 17:32:37.850796 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 153/341] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:37 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:38.727507 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a7f3d2f7-5e00-4955-98fb-a61e78fab6d4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:38.728331 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a7f3d2f7-5e00-4955-98fb-a61e78fab6d4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:38.735519 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7f3d2f7-5e00-4955-98fb-a61e78fab6d4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:38.735945 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7f3d2f7-5e00-4955-98fb-a61e78fab6d4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:38.736557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7f3d2f7-5e00-4955-98fb-a61e78fab6d4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:38.737426 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7f3d2f7-5e00-4955-98fb-a61e78fab6d4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:38.738187 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7f3d2f7-5e00-4955-98fb-a61e78fab6d4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:38.738611 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7f3d2f7-5e00-4955-98fb-a61e78fab6d4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:38.874035 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4f9574e1-e131-436b-b245-a1f828149c24 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:38.875951 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4f9574e1-e131-436b-b245-a1f828149c24 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:38.887561 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4f9574e1-e131-436b-b245-a1f828149c24 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:38.888102 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4f9574e1-e131-436b-b245-a1f828149c24 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:38.888544 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4f9574e1-e131-436b-b245-a1f828149c24 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:38.892739 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4f9574e1-e131-436b-b245-a1f828149c24 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:38.893218 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4f9574e1-e131-436b-b245-a1f828149c24 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:38.893656 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4f9574e1-e131-436b-b245-a1f828149c24 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:38.895457 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a7f3d2f7-5e00-4955-98fb-a61e78fab6d4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:38.904935 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a7f3d2f7-5e00-4955-98fb-a61e78fab6d4 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.181482 Oct 27 17:32:38.920483 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 189/342] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:38 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:39.065291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4f9574e1-e131-436b-b245-a1f828149c24 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:39.073136 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4f9574e1-e131-436b-b245-a1f828149c24 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.203727 Oct 27 17:32:39.088132 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 154/343] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:38 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:39.930987 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-cebff2b5-49f0-4df3-b53d-184bada0a131 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:39.931606 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-cebff2b5-49f0-4df3-b53d-184bada0a131 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:39.938712 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cebff2b5-49f0-4df3-b53d-184bada0a131 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:39.939341 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cebff2b5-49f0-4df3-b53d-184bada0a131 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:39.939890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cebff2b5-49f0-4df3-b53d-184bada0a131 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:39.940592 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cebff2b5-49f0-4df3-b53d-184bada0a131 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:39.941054 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cebff2b5-49f0-4df3-b53d-184bada0a131 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:39.941480 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cebff2b5-49f0-4df3-b53d-184bada0a131 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:40.097654 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f23a7431-5b5b-4b49-82bd-beab445cd4a0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:40.098215 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-f23a7431-5b5b-4b49-82bd-beab445cd4a0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:40.104541 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f23a7431-5b5b-4b49-82bd-beab445cd4a0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:40.105027 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f23a7431-5b5b-4b49-82bd-beab445cd4a0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:40.105463 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f23a7431-5b5b-4b49-82bd-beab445cd4a0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:40.106411 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f23a7431-5b5b-4b49-82bd-beab445cd4a0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:40.106871 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f23a7431-5b5b-4b49-82bd-beab445cd4a0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:40.107294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f23a7431-5b5b-4b49-82bd-beab445cd4a0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:40.141461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-cebff2b5-49f0-4df3-b53d-184bada0a131 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:40.154144 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-cebff2b5-49f0-4df3-b53d-184bada0a131 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.227254 Oct 27 17:32:40.154769 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 190/344] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:39 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:40.278231 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f23a7431-5b5b-4b49-82bd-beab445cd4a0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:40.291472 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f23a7431-5b5b-4b49-82bd-beab445cd4a0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.198277 Oct 27 17:32:40.302184 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 155/345] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:40 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:41.181444 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-81abfa3a-a5b9-4a1d-8168-b053b2b37eaf tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:41.182092 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-81abfa3a-a5b9-4a1d-8168-b053b2b37eaf tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:41.188547 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81abfa3a-a5b9-4a1d-8168-b053b2b37eaf tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:41.189047 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81abfa3a-a5b9-4a1d-8168-b053b2b37eaf tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:41.189517 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81abfa3a-a5b9-4a1d-8168-b053b2b37eaf tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:41.190232 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81abfa3a-a5b9-4a1d-8168-b053b2b37eaf tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:41.190684 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81abfa3a-a5b9-4a1d-8168-b053b2b37eaf tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:41.191403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81abfa3a-a5b9-4a1d-8168-b053b2b37eaf tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:41.330599 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6b9dae2a-82d6-4237-9061-80d77b0e7317 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:41.332156 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6b9dae2a-82d6-4237-9061-80d77b0e7317 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:41.340713 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b9dae2a-82d6-4237-9061-80d77b0e7317 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:41.341369 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b9dae2a-82d6-4237-9061-80d77b0e7317 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:41.341803 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b9dae2a-82d6-4237-9061-80d77b0e7317 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:41.342505 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b9dae2a-82d6-4237-9061-80d77b0e7317 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:41.342950 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b9dae2a-82d6-4237-9061-80d77b0e7317 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:41.343401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b9dae2a-82d6-4237-9061-80d77b0e7317 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:41.352879 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-81abfa3a-a5b9-4a1d-8168-b053b2b37eaf tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:41.361501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-81abfa3a-a5b9-4a1d-8168-b053b2b37eaf tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.186913 Oct 27 17:32:41.362257 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 191/346] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:41 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:41.519699 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-6b9dae2a-82d6-4237-9061-80d77b0e7317 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:41.528161 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6b9dae2a-82d6-4237-9061-80d77b0e7317 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.202111 Oct 27 17:32:41.528726 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 156/347] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:41 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:42.385318 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5b45ff4a-28f7-43b5-ab63-487bb1ea2836 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:42.386577 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-5b45ff4a-28f7-43b5-ab63-487bb1ea2836 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:42.392632 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5b45ff4a-28f7-43b5-ab63-487bb1ea2836 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:42.393112 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5b45ff4a-28f7-43b5-ab63-487bb1ea2836 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:42.393545 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5b45ff4a-28f7-43b5-ab63-487bb1ea2836 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:42.394261 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5b45ff4a-28f7-43b5-ab63-487bb1ea2836 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:42.394713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5b45ff4a-28f7-43b5-ab63-487bb1ea2836 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:42.395132 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5b45ff4a-28f7-43b5-ab63-487bb1ea2836 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:42.527674 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-5b45ff4a-28f7-43b5-ab63-487bb1ea2836 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:42.535611 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5b45ff4a-28f7-43b5-ab63-487bb1ea2836 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.154152 Oct 27 17:32:42.536386 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 192/348] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:42 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:42.555919 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-bcddb040-a455-439d-add2-e3a1498978de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:42.556640 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-bcddb040-a455-439d-add2-e3a1498978de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:42.564582 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bcddb040-a455-439d-add2-e3a1498978de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:42.565154 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bcddb040-a455-439d-add2-e3a1498978de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:42.565679 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bcddb040-a455-439d-add2-e3a1498978de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:42.566631 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bcddb040-a455-439d-add2-e3a1498978de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:42.567080 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bcddb040-a455-439d-add2-e3a1498978de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:42.567523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bcddb040-a455-439d-add2-e3a1498978de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:42.715611 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-bcddb040-a455-439d-add2-e3a1498978de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:42.725157 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-bcddb040-a455-439d-add2-e3a1498978de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.177290 Oct 27 17:32:42.725723 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 157/349] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:42 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:43.559961 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ce7d169f-b530-488c-a714-51fb1a0d5119 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:43.560587 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-ce7d169f-b530-488c-a714-51fb1a0d5119 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:43.563011 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=62 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:32:43.568573 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ce7d169f-b530-488c-a714-51fb1a0d5119 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:43.569259 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ce7d169f-b530-488c-a714-51fb1a0d5119 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:43.569847 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ce7d169f-b530-488c-a714-51fb1a0d5119 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:43.570550 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ce7d169f-b530-488c-a714-51fb1a0d5119 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:43.570997 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ce7d169f-b530-488c-a714-51fb1a0d5119 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:43.571574 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ce7d169f-b530-488c-a714-51fb1a0d5119 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:43.722037 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ce7d169f-b530-488c-a714-51fb1a0d5119 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:43.729993 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-ce7d169f-b530-488c-a714-51fb1a0d5119 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.174322 Oct 27 17:32:43.731175 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 193/350] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:43 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:43.752166 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e4da8989-0737-48e4-a459-01eeb2e620cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:43.752908 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e4da8989-0737-48e4-a459-01eeb2e620cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:43.759638 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e4da8989-0737-48e4-a459-01eeb2e620cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:43.760260 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e4da8989-0737-48e4-a459-01eeb2e620cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:43.760790 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e4da8989-0737-48e4-a459-01eeb2e620cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:43.761956 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e4da8989-0737-48e4-a459-01eeb2e620cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:43.762479 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e4da8989-0737-48e4-a459-01eeb2e620cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:43.762895 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e4da8989-0737-48e4-a459-01eeb2e620cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:43.904259 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e4da8989-0737-48e4-a459-01eeb2e620cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:43.912518 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e4da8989-0737-48e4-a459-01eeb2e620cb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.165154 Oct 27 17:32:43.913130 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 158/351] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:43 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:44.755137 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-e3480819-1a2b-4d90-be1e-76def0db544a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:44.755931 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e3480819-1a2b-4d90-be1e-76def0db544a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:44.762711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e3480819-1a2b-4d90-be1e-76def0db544a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:44.763516 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e3480819-1a2b-4d90-be1e-76def0db544a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:44.764341 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e3480819-1a2b-4d90-be1e-76def0db544a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:44.765906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e3480819-1a2b-4d90-be1e-76def0db544a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:44.766722 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e3480819-1a2b-4d90-be1e-76def0db544a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:44.767359 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e3480819-1a2b-4d90-be1e-76def0db544a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:44.913233 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e3480819-1a2b-4d90-be1e-76def0db544a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:44.922509 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-e3480819-1a2b-4d90-be1e-76def0db544a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.172289 Oct 27 17:32:44.933692 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 194/352] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:44 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:44.940194 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4ca76efc-976d-45bf-8f1b-eee26eab8d9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:44.940813 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4ca76efc-976d-45bf-8f1b-eee26eab8d9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:44.948026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4ca76efc-976d-45bf-8f1b-eee26eab8d9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:44.948522 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4ca76efc-976d-45bf-8f1b-eee26eab8d9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:44.948970 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4ca76efc-976d-45bf-8f1b-eee26eab8d9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:44.949724 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4ca76efc-976d-45bf-8f1b-eee26eab8d9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:44.950429 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4ca76efc-976d-45bf-8f1b-eee26eab8d9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:44.951507 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4ca76efc-976d-45bf-8f1b-eee26eab8d9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:45.094482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4ca76efc-976d-45bf-8f1b-eee26eab8d9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:45.102390 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4ca76efc-976d-45bf-8f1b-eee26eab8d9f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.167451 Oct 27 17:32:45.102879 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 159/353] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:44 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:45.948227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-3bf54942-2856-406c-9ff3-18783c7919b3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:45.948823 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-3bf54942-2856-406c-9ff3-18783c7919b3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:45.955870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3bf54942-2856-406c-9ff3-18783c7919b3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:45.956393 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3bf54942-2856-406c-9ff3-18783c7919b3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:45.956831 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3bf54942-2856-406c-9ff3-18783c7919b3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:45.957537 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3bf54942-2856-406c-9ff3-18783c7919b3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:45.958129 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3bf54942-2856-406c-9ff3-18783c7919b3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:45.958560 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3bf54942-2856-406c-9ff3-18783c7919b3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:46.128373 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-868be3e7-1a61-44b9-80a3-67c35df35f9b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:46.128925 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-868be3e7-1a61-44b9-80a3-67c35df35f9b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:46.135657 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-868be3e7-1a61-44b9-80a3-67c35df35f9b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:46.136175 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-868be3e7-1a61-44b9-80a3-67c35df35f9b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:46.136614 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-868be3e7-1a61-44b9-80a3-67c35df35f9b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:46.137311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-868be3e7-1a61-44b9-80a3-67c35df35f9b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:46.137763 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-868be3e7-1a61-44b9-80a3-67c35df35f9b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:46.138185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-868be3e7-1a61-44b9-80a3-67c35df35f9b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:46.170702 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-3bf54942-2856-406c-9ff3-18783c7919b3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:46.183002 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-3bf54942-2856-406c-9ff3-18783c7919b3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.239426 Oct 27 17:32:46.183580 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 195/354] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:45 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:46.293516 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-868be3e7-1a61-44b9-80a3-67c35df35f9b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:46.302171 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-868be3e7-1a61-44b9-80a3-67c35df35f9b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.177662 Oct 27 17:32:46.302957 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 160/355] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:46 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:47.208737 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-62169032-399f-48c6-b40a-084b120bc8f8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:47.209355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-62169032-399f-48c6-b40a-084b120bc8f8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:47.215022 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-62169032-399f-48c6-b40a-084b120bc8f8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:47.215505 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-62169032-399f-48c6-b40a-084b120bc8f8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:47.215972 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-62169032-399f-48c6-b40a-084b120bc8f8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:47.216659 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-62169032-399f-48c6-b40a-084b120bc8f8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:47.217110 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-62169032-399f-48c6-b40a-084b120bc8f8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:47.217533 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-62169032-399f-48c6-b40a-084b120bc8f8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:47.236608 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=100 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:32:47.325519 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a6962a7a-fc95-448e-b763-f160cfbd0a46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:47.326080 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a6962a7a-fc95-448e-b763-f160cfbd0a46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:47.333725 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a6962a7a-fc95-448e-b763-f160cfbd0a46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:47.334208 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a6962a7a-fc95-448e-b763-f160cfbd0a46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:47.334966 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a6962a7a-fc95-448e-b763-f160cfbd0a46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:47.335326 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a6962a7a-fc95-448e-b763-f160cfbd0a46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:47.336329 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a6962a7a-fc95-448e-b763-f160cfbd0a46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:47.336763 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a6962a7a-fc95-448e-b763-f160cfbd0a46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:47.352546 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-62169032-399f-48c6-b40a-084b120bc8f8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:47.363047 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-62169032-399f-48c6-b40a-084b120bc8f8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.158010 Oct 27 17:32:47.372575 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 196/356] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:47 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:47.473713 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a6962a7a-fc95-448e-b763-f160cfbd0a46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:47.481676 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a6962a7a-fc95-448e-b763-f160cfbd0a46 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.160018 Oct 27 17:32:47.482240 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 161/357] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:47 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:48.386292 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d313a6fb-54da-48cc-9867-f20d7bcb2cd6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:48.386911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d313a6fb-54da-48cc-9867-f20d7bcb2cd6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:48.392902 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d313a6fb-54da-48cc-9867-f20d7bcb2cd6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:48.393384 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d313a6fb-54da-48cc-9867-f20d7bcb2cd6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:48.393814 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d313a6fb-54da-48cc-9867-f20d7bcb2cd6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:48.394502 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d313a6fb-54da-48cc-9867-f20d7bcb2cd6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:48.394949 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d313a6fb-54da-48cc-9867-f20d7bcb2cd6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:48.395806 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d313a6fb-54da-48cc-9867-f20d7bcb2cd6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:48.506102 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e0415aa4-9315-4529-8dbb-a20d7fbfb0ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:48.506794 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e0415aa4-9315-4529-8dbb-a20d7fbfb0ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:48.513561 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e0415aa4-9315-4529-8dbb-a20d7fbfb0ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:48.514169 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e0415aa4-9315-4529-8dbb-a20d7fbfb0ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:48.514671 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e0415aa4-9315-4529-8dbb-a20d7fbfb0ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:48.515463 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e0415aa4-9315-4529-8dbb-a20d7fbfb0ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:48.516011 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e0415aa4-9315-4529-8dbb-a20d7fbfb0ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:48.516499 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e0415aa4-9315-4529-8dbb-a20d7fbfb0ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:48.529229 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d313a6fb-54da-48cc-9867-f20d7bcb2cd6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:48.537409 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d313a6fb-54da-48cc-9867-f20d7bcb2cd6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.155004 Oct 27 17:32:48.538184 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 197/358] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:48 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:48.654245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e0415aa4-9315-4529-8dbb-a20d7fbfb0ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:48.662152 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e0415aa4-9315-4529-8dbb-a20d7fbfb0ba tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.160293 Oct 27 17:32:48.663074 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 162/359] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:48 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:49.561166 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c8345d79-e872-47ac-aaa2-e1a15b9a7a10 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:49.562270 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c8345d79-e872-47ac-aaa2-e1a15b9a7a10 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:49.568202 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c8345d79-e872-47ac-aaa2-e1a15b9a7a10 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:49.568678 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c8345d79-e872-47ac-aaa2-e1a15b9a7a10 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:49.569103 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c8345d79-e872-47ac-aaa2-e1a15b9a7a10 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:49.569780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c8345d79-e872-47ac-aaa2-e1a15b9a7a10 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:49.570227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c8345d79-e872-47ac-aaa2-e1a15b9a7a10 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:49.570641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c8345d79-e872-47ac-aaa2-e1a15b9a7a10 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:49.686561 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e943b12e-3fdf-420c-9a0e-d93fa9f9990e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:49.687191 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e943b12e-3fdf-420c-9a0e-d93fa9f9990e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:49.689480 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=52 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:32:49.694873 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e943b12e-3fdf-420c-9a0e-d93fa9f9990e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:49.695361 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e943b12e-3fdf-420c-9a0e-d93fa9f9990e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:49.695968 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e943b12e-3fdf-420c-9a0e-d93fa9f9990e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:49.696661 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e943b12e-3fdf-420c-9a0e-d93fa9f9990e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:49.697142 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e943b12e-3fdf-420c-9a0e-d93fa9f9990e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:49.697565 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e943b12e-3fdf-420c-9a0e-d93fa9f9990e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:49.701923 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c8345d79-e872-47ac-aaa2-e1a15b9a7a10 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:49.711155 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c8345d79-e872-47ac-aaa2-e1a15b9a7a10 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.153880 Oct 27 17:32:49.711841 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 198/360] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:49 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:49.825092 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e943b12e-3fdf-420c-9a0e-d93fa9f9990e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:49.832815 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e943b12e-3fdf-420c-9a0e-d93fa9f9990e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.150270 Oct 27 17:32:49.833379 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 163/361] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:49 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:50.734390 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0767203b-3523-4157-8fb1-92a3f3ef8611 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:50.734997 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-0767203b-3523-4157-8fb1-92a3f3ef8611 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:50.740943 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0767203b-3523-4157-8fb1-92a3f3ef8611 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:50.741418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0767203b-3523-4157-8fb1-92a3f3ef8611 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:50.741845 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0767203b-3523-4157-8fb1-92a3f3ef8611 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:50.742527 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0767203b-3523-4157-8fb1-92a3f3ef8611 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:50.742976 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0767203b-3523-4157-8fb1-92a3f3ef8611 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:50.743397 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0767203b-3523-4157-8fb1-92a3f3ef8611 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:50.861385 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-833588ee-e45f-4593-ac1a-29ee3c702fdd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:50.862699 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-833588ee-e45f-4593-ac1a-29ee3c702fdd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:50.871053 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-833588ee-e45f-4593-ac1a-29ee3c702fdd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:50.871538 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-833588ee-e45f-4593-ac1a-29ee3c702fdd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:50.871997 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-833588ee-e45f-4593-ac1a-29ee3c702fdd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:50.872694 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-833588ee-e45f-4593-ac1a-29ee3c702fdd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:50.873143 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-833588ee-e45f-4593-ac1a-29ee3c702fdd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:50.873562 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-833588ee-e45f-4593-ac1a-29ee3c702fdd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:50.877891 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-0767203b-3523-4157-8fb1-92a3f3ef8611 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:50.885515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0767203b-3523-4157-8fb1-92a3f3ef8611 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.155400 Oct 27 17:32:50.886036 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 199/362] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:50 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:51.012333 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-833588ee-e45f-4593-ac1a-29ee3c702fdd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:51.020326 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-833588ee-e45f-4593-ac1a-29ee3c702fdd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.162983 Oct 27 17:32:51.020975 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 164/363] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:50 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:51.911131 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-e2d177f9-2f78-447d-b51e-8c02a2d7ab7f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:51.911668 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e2d177f9-2f78-447d-b51e-8c02a2d7ab7f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:51.917674 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e2d177f9-2f78-447d-b51e-8c02a2d7ab7f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:51.918162 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e2d177f9-2f78-447d-b51e-8c02a2d7ab7f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:51.918597 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e2d177f9-2f78-447d-b51e-8c02a2d7ab7f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:51.919286 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e2d177f9-2f78-447d-b51e-8c02a2d7ab7f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:51.919763 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e2d177f9-2f78-447d-b51e-8c02a2d7ab7f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:51.920194 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e2d177f9-2f78-447d-b51e-8c02a2d7ab7f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:52.043990 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9e669ba8-c615-403a-a63e-f9c5474e066b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:52.044659 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9e669ba8-c615-403a-a63e-f9c5474e066b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:52.047784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e2d177f9-2f78-447d-b51e-8c02a2d7ab7f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:52.051410 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e669ba8-c615-403a-a63e-f9c5474e066b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:52.051921 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e669ba8-c615-403a-a63e-f9c5474e066b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:52.052355 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e669ba8-c615-403a-a63e-f9c5474e066b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:52.053038 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e669ba8-c615-403a-a63e-f9c5474e066b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:52.053485 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e669ba8-c615-403a-a63e-f9c5474e066b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:52.053907 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e669ba8-c615-403a-a63e-f9c5474e066b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:52.055852 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-e2d177f9-2f78-447d-b51e-8c02a2d7ab7f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.148689 Oct 27 17:32:52.056496 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 200/364] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:51 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:52.179093 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9e669ba8-c615-403a-a63e-f9c5474e066b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:52.186926 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9e669ba8-c615-403a-a63e-f9c5474e066b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.146626 Oct 27 17:32:52.187976 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 165/365] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:52 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:53.079250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1e611509-4028-4279-aa81-934fe4056d3d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:53.079908 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-1e611509-4028-4279-aa81-934fe4056d3d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:53.086002 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1e611509-4028-4279-aa81-934fe4056d3d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:53.086484 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1e611509-4028-4279-aa81-934fe4056d3d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:53.086916 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1e611509-4028-4279-aa81-934fe4056d3d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:53.087639 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1e611509-4028-4279-aa81-934fe4056d3d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:53.088214 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1e611509-4028-4279-aa81-934fe4056d3d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:53.088642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1e611509-4028-4279-aa81-934fe4056d3d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:53.210944 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-530869e1-4d00-4baa-b232-5636b44eee5e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:53.211563 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-530869e1-4d00-4baa-b232-5636b44eee5e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:53.216838 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1e611509-4028-4279-aa81-934fe4056d3d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:53.218046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-530869e1-4d00-4baa-b232-5636b44eee5e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:53.218529 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-530869e1-4d00-4baa-b232-5636b44eee5e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:53.218962 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-530869e1-4d00-4baa-b232-5636b44eee5e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:53.219652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-530869e1-4d00-4baa-b232-5636b44eee5e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:53.220132 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-530869e1-4d00-4baa-b232-5636b44eee5e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:53.220553 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-530869e1-4d00-4baa-b232-5636b44eee5e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:53.224567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1e611509-4028-4279-aa81-934fe4056d3d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.150037 Oct 27 17:32:53.225146 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 201/366] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:53 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:53.349562 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-530869e1-4d00-4baa-b232-5636b44eee5e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:53.357838 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-530869e1-4d00-4baa-b232-5636b44eee5e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.150717 Oct 27 17:32:53.358530 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 166/367] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:53 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:54.248281 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a538d22a-caa4-4f30-8215-feef320c6979 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:54.248936 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a538d22a-caa4-4f30-8215-feef320c6979 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:54.255531 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a538d22a-caa4-4f30-8215-feef320c6979 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:54.255971 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a538d22a-caa4-4f30-8215-feef320c6979 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:54.256416 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a538d22a-caa4-4f30-8215-feef320c6979 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:54.257056 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a538d22a-caa4-4f30-8215-feef320c6979 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:54.257513 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a538d22a-caa4-4f30-8215-feef320c6979 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:54.257970 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a538d22a-caa4-4f30-8215-feef320c6979 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:54.382024 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-5742f723-d716-4983-af29-6b424953bc6c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:54.383242 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-5742f723-d716-4983-af29-6b424953bc6c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:54.390606 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5742f723-d716-4983-af29-6b424953bc6c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:54.394110 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a538d22a-caa4-4f30-8215-feef320c6979 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:54.396055 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5742f723-d716-4983-af29-6b424953bc6c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:54.396524 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5742f723-d716-4983-af29-6b424953bc6c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:54.397239 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5742f723-d716-4983-af29-6b424953bc6c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:54.397697 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5742f723-d716-4983-af29-6b424953bc6c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:54.398116 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5742f723-d716-4983-af29-6b424953bc6c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:54.411076 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a538d22a-caa4-4f30-8215-feef320c6979 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.167095 Oct 27 17:32:54.411685 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 202/368] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:54 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:54.537385 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5742f723-d716-4983-af29-6b424953bc6c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:54.545268 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-5742f723-d716-4983-af29-6b424953bc6c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.167962 Oct 27 17:32:54.545951 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 167/369] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:54 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:55.435147 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-61b4bda0-e6e1-4cf5-9137-6da9798cde1d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:55.436035 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-61b4bda0-e6e1-4cf5-9137-6da9798cde1d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:55.443309 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61b4bda0-e6e1-4cf5-9137-6da9798cde1d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:55.443823 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61b4bda0-e6e1-4cf5-9137-6da9798cde1d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:55.444470 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61b4bda0-e6e1-4cf5-9137-6da9798cde1d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:55.445683 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61b4bda0-e6e1-4cf5-9137-6da9798cde1d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:55.446198 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61b4bda0-e6e1-4cf5-9137-6da9798cde1d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:55.446590 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61b4bda0-e6e1-4cf5-9137-6da9798cde1d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:55.568229 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0a5afd41-6acb-4aad-97df-780d35835f51 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:55.568951 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-0a5afd41-6acb-4aad-97df-780d35835f51 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:55.576320 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0a5afd41-6acb-4aad-97df-780d35835f51 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:55.577376 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0a5afd41-6acb-4aad-97df-780d35835f51 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:55.578017 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0a5afd41-6acb-4aad-97df-780d35835f51 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:55.578792 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0a5afd41-6acb-4aad-97df-780d35835f51 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:55.579316 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0a5afd41-6acb-4aad-97df-780d35835f51 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:55.579848 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0a5afd41-6acb-4aad-97df-780d35835f51 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:55.608107 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-61b4bda0-e6e1-4cf5-9137-6da9798cde1d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:55.619084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-61b4bda0-e6e1-4cf5-9137-6da9798cde1d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.187723 Oct 27 17:32:55.620057 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 203/370] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:55 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:55.723543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0a5afd41-6acb-4aad-97df-780d35835f51 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:55.731369 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0a5afd41-6acb-4aad-97df-780d35835f51 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.166942 Oct 27 17:32:55.731971 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 168/371] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:55 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:56.642298 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-330f7c15-403d-4a35-9ab6-a0f7f0dd7a69 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:56.644050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-330f7c15-403d-4a35-9ab6-a0f7f0dd7a69 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:56.649980 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-330f7c15-403d-4a35-9ab6-a0f7f0dd7a69 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:56.650463 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-330f7c15-403d-4a35-9ab6-a0f7f0dd7a69 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:56.650892 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-330f7c15-403d-4a35-9ab6-a0f7f0dd7a69 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:56.651582 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-330f7c15-403d-4a35-9ab6-a0f7f0dd7a69 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:56.652059 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-330f7c15-403d-4a35-9ab6-a0f7f0dd7a69 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:56.652479 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-330f7c15-403d-4a35-9ab6-a0f7f0dd7a69 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:56.755705 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4eba76cd-03a2-408f-8541-defe0d43eacd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:56.756976 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4eba76cd-03a2-408f-8541-defe0d43eacd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:56.763787 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4eba76cd-03a2-408f-8541-defe0d43eacd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:56.764375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4eba76cd-03a2-408f-8541-defe0d43eacd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:56.764960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4eba76cd-03a2-408f-8541-defe0d43eacd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:56.765799 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4eba76cd-03a2-408f-8541-defe0d43eacd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:56.766415 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4eba76cd-03a2-408f-8541-defe0d43eacd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:56.766945 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4eba76cd-03a2-408f-8541-defe0d43eacd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:56.787482 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-330f7c15-403d-4a35-9ab6-a0f7f0dd7a69 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:56.797730 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-330f7c15-403d-4a35-9ab6-a0f7f0dd7a69 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.159736 Oct 27 17:32:56.798587 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 204/372] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:56 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:56.916994 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4eba76cd-03a2-408f-8541-defe0d43eacd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:56.925497 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4eba76cd-03a2-408f-8541-defe0d43eacd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.174262 Oct 27 17:32:56.926059 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 169/373] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:56 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:57.821642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-66318b48-0190-4d7b-ba88-213bd2760af1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:57.822286 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-66318b48-0190-4d7b-ba88-213bd2760af1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:57.829134 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-66318b48-0190-4d7b-ba88-213bd2760af1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:57.829668 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-66318b48-0190-4d7b-ba88-213bd2760af1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:57.830105 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-66318b48-0190-4d7b-ba88-213bd2760af1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:57.830864 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-66318b48-0190-4d7b-ba88-213bd2760af1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:57.831363 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-66318b48-0190-4d7b-ba88-213bd2760af1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:57.831866 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-66318b48-0190-4d7b-ba88-213bd2760af1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:57.949795 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0b69b02c-197c-4048-9a66-7d65ee9aa8e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:57.950646 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-0b69b02c-197c-4048-9a66-7d65ee9aa8e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:57.958048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b69b02c-197c-4048-9a66-7d65ee9aa8e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:57.958523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b69b02c-197c-4048-9a66-7d65ee9aa8e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:57.959126 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b69b02c-197c-4048-9a66-7d65ee9aa8e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:57.959837 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b69b02c-197c-4048-9a66-7d65ee9aa8e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:57.960285 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b69b02c-197c-4048-9a66-7d65ee9aa8e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:57.960698 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b69b02c-197c-4048-9a66-7d65ee9aa8e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:57.965291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=100 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:32:57.976384 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-66318b48-0190-4d7b-ba88-213bd2760af1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:57.985099 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-66318b48-0190-4d7b-ba88-213bd2760af1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.167356 Oct 27 17:32:57.985751 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 205/374] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:57 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:58.103166 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0b69b02c-197c-4048-9a66-7d65ee9aa8e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:58.112180 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0b69b02c-197c-4048-9a66-7d65ee9aa8e7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.166875 Oct 27 17:32:58.112739 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 170/375] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:57 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:32:59.007652 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-7f826018-a7cc-45e4-ba5b-6894b3cd7183 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:59.008295 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-7f826018-a7cc-45e4-ba5b-6894b3cd7183 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:59.014924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f826018-a7cc-45e4-ba5b-6894b3cd7183 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:59.015413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f826018-a7cc-45e4-ba5b-6894b3cd7183 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:59.015875 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f826018-a7cc-45e4-ba5b-6894b3cd7183 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:59.016600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f826018-a7cc-45e4-ba5b-6894b3cd7183 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:59.017050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f826018-a7cc-45e4-ba5b-6894b3cd7183 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:59.017499 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f826018-a7cc-45e4-ba5b-6894b3cd7183 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:59.136273 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0f1b2f8d-14dd-42b5-af39-7b9b8c03fdcd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:32:59.137547 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-0f1b2f8d-14dd-42b5-af39-7b9b8c03fdcd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:32:59.144664 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0f1b2f8d-14dd-42b5-af39-7b9b8c03fdcd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:59.145449 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0f1b2f8d-14dd-42b5-af39-7b9b8c03fdcd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:59.145960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0f1b2f8d-14dd-42b5-af39-7b9b8c03fdcd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:59.146738 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0f1b2f8d-14dd-42b5-af39-7b9b8c03fdcd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:32:59.147297 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0f1b2f8d-14dd-42b5-af39-7b9b8c03fdcd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:32:59.147744 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0f1b2f8d-14dd-42b5-af39-7b9b8c03fdcd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:32:59.149064 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7f826018-a7cc-45e4-ba5b-6894b3cd7183 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:59.157262 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-7f826018-a7cc-45e4-ba5b-6894b3cd7183 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.153442 Oct 27 17:32:59.157827 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 206/376] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:59 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:32:59.286337 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0f1b2f8d-14dd-42b5-af39-7b9b8c03fdcd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:32:59.295171 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0f1b2f8d-14dd-42b5-af39-7b9b8c03fdcd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.162765 Oct 27 17:32:59.297109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 171/377] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:32:59 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:00.181678 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-537c5c49-fbcd-467c-a63f-3bb8c0868544 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:00.182299 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-537c5c49-fbcd-467c-a63f-3bb8c0868544 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:00.193553 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-537c5c49-fbcd-467c-a63f-3bb8c0868544 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:00.194144 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-537c5c49-fbcd-467c-a63f-3bb8c0868544 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:00.194688 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-537c5c49-fbcd-467c-a63f-3bb8c0868544 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:00.195528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-537c5c49-fbcd-467c-a63f-3bb8c0868544 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:00.196214 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-537c5c49-fbcd-467c-a63f-3bb8c0868544 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:00.196836 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-537c5c49-fbcd-467c-a63f-3bb8c0868544 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:00.322333 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-09a49bbe-15ac-4b33-94f7-a2a1a586767f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:00.323866 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-09a49bbe-15ac-4b33-94f7-a2a1a586767f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:00.341087 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-09a49bbe-15ac-4b33-94f7-a2a1a586767f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:00.342038 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-09a49bbe-15ac-4b33-94f7-a2a1a586767f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:00.343194 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-09a49bbe-15ac-4b33-94f7-a2a1a586767f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:00.344290 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-09a49bbe-15ac-4b33-94f7-a2a1a586767f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:00.345041 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-09a49bbe-15ac-4b33-94f7-a2a1a586767f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:00.345781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-09a49bbe-15ac-4b33-94f7-a2a1a586767f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:00.406082 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-537c5c49-fbcd-467c-a63f-3bb8c0868544 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:00.415410 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-537c5c49-fbcd-467c-a63f-3bb8c0868544 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.236705 Oct 27 17:33:00.415410 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 207/378] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:00 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:00.513988 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-09a49bbe-15ac-4b33-94f7-a2a1a586767f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:00.521987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-09a49bbe-15ac-4b33-94f7-a2a1a586767f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.204587 Oct 27 17:33:00.522670 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 172/379] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:00 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:01.441067 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-def3fc62-cfdc-4157-89ff-de3eef3a5ba8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:01.441727 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-def3fc62-cfdc-4157-89ff-de3eef3a5ba8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:01.447814 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-def3fc62-cfdc-4157-89ff-de3eef3a5ba8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:01.448304 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-def3fc62-cfdc-4157-89ff-de3eef3a5ba8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:01.448741 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-def3fc62-cfdc-4157-89ff-de3eef3a5ba8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:01.449434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-def3fc62-cfdc-4157-89ff-de3eef3a5ba8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:01.449888 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-def3fc62-cfdc-4157-89ff-de3eef3a5ba8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:01.450314 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-def3fc62-cfdc-4157-89ff-de3eef3a5ba8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:01.544673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-12c03f42-6b7b-4f01-b03c-1d521950db89 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:01.546016 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-12c03f42-6b7b-4f01-b03c-1d521950db89 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:01.552605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-12c03f42-6b7b-4f01-b03c-1d521950db89 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:01.553336 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-12c03f42-6b7b-4f01-b03c-1d521950db89 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:01.553981 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-12c03f42-6b7b-4f01-b03c-1d521950db89 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:01.554858 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-12c03f42-6b7b-4f01-b03c-1d521950db89 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:01.555558 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-12c03f42-6b7b-4f01-b03c-1d521950db89 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:01.556184 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-12c03f42-6b7b-4f01-b03c-1d521950db89 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:01.593626 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-def3fc62-cfdc-4157-89ff-de3eef3a5ba8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:01.602263 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-def3fc62-cfdc-4157-89ff-de3eef3a5ba8 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.165891 Oct 27 17:33:01.603167 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 208/380] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:01 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:01.700558 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-12c03f42-6b7b-4f01-b03c-1d521950db89 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:01.708299 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-12c03f42-6b7b-4f01-b03c-1d521950db89 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.167345 Oct 27 17:33:01.708965 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 173/381] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:01 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:02.625902 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b5a394cf-39c9-434b-b39b-3b2d9f1a1a62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:02.626545 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b5a394cf-39c9-434b-b39b-3b2d9f1a1a62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:02.632484 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b5a394cf-39c9-434b-b39b-3b2d9f1a1a62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:02.632965 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b5a394cf-39c9-434b-b39b-3b2d9f1a1a62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:02.633405 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b5a394cf-39c9-434b-b39b-3b2d9f1a1a62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:02.634083 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b5a394cf-39c9-434b-b39b-3b2d9f1a1a62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:02.634559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b5a394cf-39c9-434b-b39b-3b2d9f1a1a62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:02.634980 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b5a394cf-39c9-434b-b39b-3b2d9f1a1a62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:02.730425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-16020b2f-64d7-47a1-aee6-cff91f662f91 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:02.731281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-16020b2f-64d7-47a1-aee6-cff91f662f91 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:02.738412 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-16020b2f-64d7-47a1-aee6-cff91f662f91 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:02.738891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-16020b2f-64d7-47a1-aee6-cff91f662f91 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:02.739318 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-16020b2f-64d7-47a1-aee6-cff91f662f91 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:02.740036 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-16020b2f-64d7-47a1-aee6-cff91f662f91 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:02.740480 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-16020b2f-64d7-47a1-aee6-cff91f662f91 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:02.740894 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-16020b2f-64d7-47a1-aee6-cff91f662f91 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:02.762034 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-b5a394cf-39c9-434b-b39b-3b2d9f1a1a62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:02.769033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b5a394cf-39c9-434b-b39b-3b2d9f1a1a62 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.147465 Oct 27 17:33:02.769789 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 209/382] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:02 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:02.868352 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-16020b2f-64d7-47a1-aee6-cff91f662f91 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:02.876568 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-16020b2f-64d7-47a1-aee6-cff91f662f91 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.149996 Oct 27 17:33:02.877120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 174/383] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:02 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:03.795119 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ff521e99-bc68-467e-b4f8-e7d3959311e9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:03.797581 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-ff521e99-bc68-467e-b4f8-e7d3959311e9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:03.809179 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ff521e99-bc68-467e-b4f8-e7d3959311e9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:03.809780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ff521e99-bc68-467e-b4f8-e7d3959311e9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:03.810212 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ff521e99-bc68-467e-b4f8-e7d3959311e9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:03.810920 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ff521e99-bc68-467e-b4f8-e7d3959311e9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:03.811411 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ff521e99-bc68-467e-b4f8-e7d3959311e9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:03.812197 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ff521e99-bc68-467e-b4f8-e7d3959311e9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:03.899945 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-eb6a2c34-c1a8-45d5-92db-bf875f266d39 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:03.900771 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-eb6a2c34-c1a8-45d5-92db-bf875f266d39 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:03.908441 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eb6a2c34-c1a8-45d5-92db-bf875f266d39 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:03.909023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eb6a2c34-c1a8-45d5-92db-bf875f266d39 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:03.909872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eb6a2c34-c1a8-45d5-92db-bf875f266d39 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:03.910619 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eb6a2c34-c1a8-45d5-92db-bf875f266d39 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:03.911611 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eb6a2c34-c1a8-45d5-92db-bf875f266d39 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:03.912130 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eb6a2c34-c1a8-45d5-92db-bf875f266d39 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:03.956903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ff521e99-bc68-467e-b4f8-e7d3959311e9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:03.964772 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-ff521e99-bc68-467e-b4f8-e7d3959311e9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.175787 Oct 27 17:33:03.965356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 210/384] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:03 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:04.056110 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-eb6a2c34-c1a8-45d5-92db-bf875f266d39 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:04.064476 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-eb6a2c34-c1a8-45d5-92db-bf875f266d39 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.168581 Oct 27 17:33:04.065050 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 175/385] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:03 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:04.988477 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-faa1d02d-f629-4e0f-a58f-51b75b48b40a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:04.989223 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-faa1d02d-f629-4e0f-a58f-51b75b48b40a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:04.995117 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-faa1d02d-f629-4e0f-a58f-51b75b48b40a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:04.995596 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-faa1d02d-f629-4e0f-a58f-51b75b48b40a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:04.996068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-faa1d02d-f629-4e0f-a58f-51b75b48b40a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:04.996859 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-faa1d02d-f629-4e0f-a58f-51b75b48b40a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:04.997221 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-faa1d02d-f629-4e0f-a58f-51b75b48b40a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:04.997706 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-faa1d02d-f629-4e0f-a58f-51b75b48b40a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:05.087690 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-fcc716c8-8933-478e-ab55-adab9c91cab4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:05.088317 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-fcc716c8-8933-478e-ab55-adab9c91cab4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:05.094884 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fcc716c8-8933-478e-ab55-adab9c91cab4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:05.095372 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fcc716c8-8933-478e-ab55-adab9c91cab4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:05.095835 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fcc716c8-8933-478e-ab55-adab9c91cab4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:05.096530 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fcc716c8-8933-478e-ab55-adab9c91cab4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:05.096983 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fcc716c8-8933-478e-ab55-adab9c91cab4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:05.097409 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fcc716c8-8933-478e-ab55-adab9c91cab4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:05.131046 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-faa1d02d-f629-4e0f-a58f-51b75b48b40a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:05.139226 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-faa1d02d-f629-4e0f-a58f-51b75b48b40a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.154351 Oct 27 17:33:05.139742 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 211/386] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:04 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:05.230911 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-fcc716c8-8933-478e-ab55-adab9c91cab4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:05.239257 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-fcc716c8-8933-478e-ab55-adab9c91cab4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.155476 Oct 27 17:33:05.239860 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 176/387] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:05 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:06.162297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a9ece64b-c900-447a-b06c-7a0c4bb8241a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:06.162903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a9ece64b-c900-447a-b06c-7a0c4bb8241a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:06.168881 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a9ece64b-c900-447a-b06c-7a0c4bb8241a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:06.169363 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a9ece64b-c900-447a-b06c-7a0c4bb8241a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:06.169795 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a9ece64b-c900-447a-b06c-7a0c4bb8241a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:06.170479 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a9ece64b-c900-447a-b06c-7a0c4bb8241a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:06.170929 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a9ece64b-c900-447a-b06c-7a0c4bb8241a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:06.171350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a9ece64b-c900-447a-b06c-7a0c4bb8241a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:06.262787 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d3381841-c7d0-4f52-aff2-abcac433ace2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:06.263583 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d3381841-c7d0-4f52-aff2-abcac433ace2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:06.270706 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3381841-c7d0-4f52-aff2-abcac433ace2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:06.271199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3381841-c7d0-4f52-aff2-abcac433ace2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:06.271626 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3381841-c7d0-4f52-aff2-abcac433ace2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:06.272356 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3381841-c7d0-4f52-aff2-abcac433ace2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:06.272812 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3381841-c7d0-4f52-aff2-abcac433ace2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:06.273241 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3381841-c7d0-4f52-aff2-abcac433ace2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:06.301855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a9ece64b-c900-447a-b06c-7a0c4bb8241a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:06.309527 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a9ece64b-c900-447a-b06c-7a0c4bb8241a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.151073 Oct 27 17:33:06.310113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 212/388] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:06 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:06.410583 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d3381841-c7d0-4f52-aff2-abcac433ace2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:06.418215 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d3381841-c7d0-4f52-aff2-abcac433ace2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.159415 Oct 27 17:33:06.418781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 177/389] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:06 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:07.332913 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ec43f917-f6f1-44bf-bd5f-c014de53915f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:07.333443 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-ec43f917-f6f1-44bf-bd5f-c014de53915f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:07.340431 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ec43f917-f6f1-44bf-bd5f-c014de53915f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:07.340915 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ec43f917-f6f1-44bf-bd5f-c014de53915f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:07.341396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ec43f917-f6f1-44bf-bd5f-c014de53915f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:07.342124 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ec43f917-f6f1-44bf-bd5f-c014de53915f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:07.342589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ec43f917-f6f1-44bf-bd5f-c014de53915f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:07.343021 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ec43f917-f6f1-44bf-bd5f-c014de53915f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:07.347805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=100 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:33:07.442001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b4f284f6-6c46-4a1b-93ae-cda7f8ff43a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:07.442614 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b4f284f6-6c46-4a1b-93ae-cda7f8ff43a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:07.449150 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4f284f6-6c46-4a1b-93ae-cda7f8ff43a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:07.449634 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4f284f6-6c46-4a1b-93ae-cda7f8ff43a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:07.450073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4f284f6-6c46-4a1b-93ae-cda7f8ff43a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:07.450767 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4f284f6-6c46-4a1b-93ae-cda7f8ff43a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:07.451221 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4f284f6-6c46-4a1b-93ae-cda7f8ff43a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:07.452158 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4f284f6-6c46-4a1b-93ae-cda7f8ff43a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:07.488858 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ec43f917-f6f1-44bf-bd5f-c014de53915f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:07.502246 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-ec43f917-f6f1-44bf-bd5f-c014de53915f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.173424 Oct 27 17:33:07.508800 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 213/390] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:07 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:07.594321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b4f284f6-6c46-4a1b-93ae-cda7f8ff43a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:07.602115 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b4f284f6-6c46-4a1b-93ae-cda7f8ff43a8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.164436 Oct 27 17:33:07.602678 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 178/391] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:07 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:08.525756 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-46b17234-6d91-4ed6-af75-3ba012720d91 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:08.526364 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-46b17234-6d91-4ed6-af75-3ba012720d91 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:08.532856 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-46b17234-6d91-4ed6-af75-3ba012720d91 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:08.533336 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-46b17234-6d91-4ed6-af75-3ba012720d91 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:08.533772 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-46b17234-6d91-4ed6-af75-3ba012720d91 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:08.534450 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-46b17234-6d91-4ed6-af75-3ba012720d91 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:08.534903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-46b17234-6d91-4ed6-af75-3ba012720d91 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:08.535319 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-46b17234-6d91-4ed6-af75-3ba012720d91 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:08.626495 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-cb71ca69-cb4e-4443-af5d-057580786c5c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:08.627851 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-cb71ca69-cb4e-4443-af5d-057580786c5c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:08.634443 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb71ca69-cb4e-4443-af5d-057580786c5c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:08.635017 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb71ca69-cb4e-4443-af5d-057580786c5c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:08.635740 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb71ca69-cb4e-4443-af5d-057580786c5c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:08.636683 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb71ca69-cb4e-4443-af5d-057580786c5c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:08.637234 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb71ca69-cb4e-4443-af5d-057580786c5c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:08.637726 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb71ca69-cb4e-4443-af5d-057580786c5c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:08.667333 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-46b17234-6d91-4ed6-af75-3ba012720d91 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:08.675873 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-46b17234-6d91-4ed6-af75-3ba012720d91 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.153933 Oct 27 17:33:08.676809 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 214/392] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:08 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:08.771345 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-cb71ca69-cb4e-4443-af5d-057580786c5c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:08.779065 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-cb71ca69-cb4e-4443-af5d-057580786c5c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.157170 Oct 27 17:33:08.779690 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 179/393] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:08 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:09.699007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f80c6ece-6459-4b13-8643-073d6493e7f9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:09.699623 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f80c6ece-6459-4b13-8643-073d6493e7f9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:09.705585 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f80c6ece-6459-4b13-8643-073d6493e7f9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:09.706068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f80c6ece-6459-4b13-8643-073d6493e7f9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:09.706503 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f80c6ece-6459-4b13-8643-073d6493e7f9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:09.707190 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f80c6ece-6459-4b13-8643-073d6493e7f9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:09.707645 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f80c6ece-6459-4b13-8643-073d6493e7f9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:09.708099 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f80c6ece-6459-4b13-8643-073d6493e7f9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:09.802492 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-1242f78b-0977-4509-804c-8154477f45be tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:09.803317 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-1242f78b-0977-4509-804c-8154477f45be tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:09.809794 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1242f78b-0977-4509-804c-8154477f45be tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:09.810274 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1242f78b-0977-4509-804c-8154477f45be tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:09.810713 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1242f78b-0977-4509-804c-8154477f45be tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:09.811404 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1242f78b-0977-4509-804c-8154477f45be tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:09.811888 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1242f78b-0977-4509-804c-8154477f45be tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:09.812308 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1242f78b-0977-4509-804c-8154477f45be tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:09.839356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f80c6ece-6459-4b13-8643-073d6493e7f9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:09.847547 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f80c6ece-6459-4b13-8643-073d6493e7f9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.152358 Oct 27 17:33:09.848161 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 215/394] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:09 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:09.943115 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1242f78b-0977-4509-804c-8154477f45be tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:09.951036 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-1242f78b-0977-4509-804c-8154477f45be tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.152513 Oct 27 17:33:09.951618 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 180/395] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:09 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:10.870554 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-07f0c039-10c8-42cb-97f1-8851d084598d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:10.871176 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-07f0c039-10c8-42cb-97f1-8851d084598d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:10.877184 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-07f0c039-10c8-42cb-97f1-8851d084598d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:10.877662 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-07f0c039-10c8-42cb-97f1-8851d084598d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:10.878093 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-07f0c039-10c8-42cb-97f1-8851d084598d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:10.878783 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-07f0c039-10c8-42cb-97f1-8851d084598d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:10.879236 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-07f0c039-10c8-42cb-97f1-8851d084598d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:10.879658 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-07f0c039-10c8-42cb-97f1-8851d084598d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:10.974037 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4e7b0c75-9249-4471-b9fa-3385cb25ee45 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:10.974774 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4e7b0c75-9249-4471-b9fa-3385cb25ee45 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:10.981478 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4e7b0c75-9249-4471-b9fa-3385cb25ee45 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:10.982269 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4e7b0c75-9249-4471-b9fa-3385cb25ee45 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:10.982910 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4e7b0c75-9249-4471-b9fa-3385cb25ee45 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:10.983867 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4e7b0c75-9249-4471-b9fa-3385cb25ee45 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:10.985736 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4e7b0c75-9249-4471-b9fa-3385cb25ee45 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:10.987037 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4e7b0c75-9249-4471-b9fa-3385cb25ee45 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:11.011097 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-07f0c039-10c8-42cb-97f1-8851d084598d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:11.020041 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-07f0c039-10c8-42cb-97f1-8851d084598d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.153332 Oct 27 17:33:11.020630 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 216/396] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:10 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:11.126271 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4e7b0c75-9249-4471-b9fa-3385cb25ee45 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:11.135664 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4e7b0c75-9249-4471-b9fa-3385cb25ee45 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.165439 Oct 27 17:33:11.137181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 181/397] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:10 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:12.044627 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d5130829-1387-482e-b9ae-146ec313ba5b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:12.045294 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d5130829-1387-482e-b9ae-146ec313ba5b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:12.051293 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d5130829-1387-482e-b9ae-146ec313ba5b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:12.051811 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d5130829-1387-482e-b9ae-146ec313ba5b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:12.052251 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d5130829-1387-482e-b9ae-146ec313ba5b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:12.052945 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d5130829-1387-482e-b9ae-146ec313ba5b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:12.053399 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d5130829-1387-482e-b9ae-146ec313ba5b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:12.053828 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d5130829-1387-482e-b9ae-146ec313ba5b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:12.159418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-92a82618-0ca5-491e-b84f-5fbe2c99e4c2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:12.160057 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-92a82618-0ca5-491e-b84f-5fbe2c99e4c2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:12.169427 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-92a82618-0ca5-491e-b84f-5fbe2c99e4c2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:12.169923 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-92a82618-0ca5-491e-b84f-5fbe2c99e4c2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:12.170389 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-92a82618-0ca5-491e-b84f-5fbe2c99e4c2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:12.171106 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-92a82618-0ca5-491e-b84f-5fbe2c99e4c2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:12.171558 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-92a82618-0ca5-491e-b84f-5fbe2c99e4c2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:12.172001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-92a82618-0ca5-491e-b84f-5fbe2c99e4c2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:12.182911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d5130829-1387-482e-b9ae-146ec313ba5b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:12.192030 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d5130829-1387-482e-b9ae-146ec313ba5b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.151177 Oct 27 17:33:12.192660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 217/398] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:12 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:12.316776 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-92a82618-0ca5-491e-b84f-5fbe2c99e4c2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:12.325930 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-92a82618-0ca5-491e-b84f-5fbe2c99e4c2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.170268 Oct 27 17:33:12.327346 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 182/399] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:12 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:13.216334 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-dd16fb2a-6156-44ad-9599-9918e2dba9dd tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:13.216887 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-dd16fb2a-6156-44ad-9599-9918e2dba9dd tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:13.222968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd16fb2a-6156-44ad-9599-9918e2dba9dd tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:13.223451 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd16fb2a-6156-44ad-9599-9918e2dba9dd tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:13.224145 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd16fb2a-6156-44ad-9599-9918e2dba9dd tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:13.224848 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd16fb2a-6156-44ad-9599-9918e2dba9dd tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:13.225299 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd16fb2a-6156-44ad-9599-9918e2dba9dd tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:13.225725 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd16fb2a-6156-44ad-9599-9918e2dba9dd tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:13.349112 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f3f83700-131e-480c-8d47-6e7e593d93d9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:13.349885 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-f3f83700-131e-480c-8d47-6e7e593d93d9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:13.357320 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f3f83700-131e-480c-8d47-6e7e593d93d9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:13.358300 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f3f83700-131e-480c-8d47-6e7e593d93d9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:13.358726 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f3f83700-131e-480c-8d47-6e7e593d93d9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:13.358973 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-dd16fb2a-6156-44ad-9599-9918e2dba9dd tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:13.359416 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f3f83700-131e-480c-8d47-6e7e593d93d9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:13.359892 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f3f83700-131e-480c-8d47-6e7e593d93d9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:13.360312 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f3f83700-131e-480c-8d47-6e7e593d93d9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:13.366680 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-dd16fb2a-6156-44ad-9599-9918e2dba9dd tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.154566 Oct 27 17:33:13.367245 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 218/400] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:13 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:13.496336 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f3f83700-131e-480c-8d47-6e7e593d93d9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:13.504798 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f3f83700-131e-480c-8d47-6e7e593d93d9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1522 microversion: 2.1 time: 0.159614 Oct 27 17:33:13.505389 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 183/401] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:13 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:14.144047 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-8c3976b7-c5d8-4b9a-a346-78d56dc560b9 req-e7bd1448-e2d3-4a90-8a95-7349da54cdbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95000566-a99d-4dc8-b509-bc86de3e8743", "name": "network-vif-plugged", "status": "completed", "tag": "e5243648-b4fa-47b1-96eb-9bf82da1c364"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:33:14.150772 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=52 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:33:14.158251 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-8c3976b7-c5d8-4b9a-a346-78d56dc560b9 req-e7bd1448-e2d3-4a90-8a95-7349da54cdbf service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:14.177391 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-8c3976b7-c5d8-4b9a-a346-78d56dc560b9 req-e7bd1448-e2d3-4a90-8a95-7349da54cdbf service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:14.177984 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-8c3976b7-c5d8-4b9a-a346-78d56dc560b9 req-e7bd1448-e2d3-4a90-8a95-7349da54cdbf service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:14.212223 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-8c3976b7-c5d8-4b9a-a346-78d56dc560b9 req-e7bd1448-e2d3-4a90-8a95-7349da54cdbf service nova] Creating event network-vif-plugged:e5243648-b4fa-47b1-96eb-9bf82da1c364 for instance 95000566-a99d-4dc8-b509-bc86de3e8743 on hv-cinder-86283 Oct 27 17:33:14.220150 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-8c3976b7-c5d8-4b9a-a346-78d56dc560b9 req-e7bd1448-e2d3-4a90-8a95-7349da54cdbf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079354 Oct 27 17:33:14.221832 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 219/402] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:33:14.391902 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-5d294e3d-49cc-4b99-ad03-a4889be9a399 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:14.392567 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-5d294e3d-49cc-4b99-ad03-a4889be9a399 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:14.399033 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5d294e3d-49cc-4b99-ad03-a4889be9a399 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:14.399576 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5d294e3d-49cc-4b99-ad03-a4889be9a399 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:14.400048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5d294e3d-49cc-4b99-ad03-a4889be9a399 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:14.400762 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5d294e3d-49cc-4b99-ad03-a4889be9a399 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:14.401220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5d294e3d-49cc-4b99-ad03-a4889be9a399 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:14.401629 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5d294e3d-49cc-4b99-ad03-a4889be9a399 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:14.528884 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6ac83309-2d85-4a09-b196-617dccdb7501 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:14.529554 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-6ac83309-2d85-4a09-b196-617dccdb7501 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:14.535524 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6ac83309-2d85-4a09-b196-617dccdb7501 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:14.536036 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6ac83309-2d85-4a09-b196-617dccdb7501 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:14.536468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6ac83309-2d85-4a09-b196-617dccdb7501 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:14.537168 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6ac83309-2d85-4a09-b196-617dccdb7501 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:14.537614 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6ac83309-2d85-4a09-b196-617dccdb7501 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:14.538031 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6ac83309-2d85-4a09-b196-617dccdb7501 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:14.567606 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5d294e3d-49cc-4b99-ad03-a4889be9a399 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:14.575523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-5d294e3d-49cc-4b99-ad03-a4889be9a399 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.189119 Oct 27 17:33:14.576137 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 184/403] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:14 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:14.671422 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-6ac83309-2d85-4a09-b196-617dccdb7501 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:14.679140 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6ac83309-2d85-4a09-b196-617dccdb7501 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1502 microversion: 2.1 time: 0.154529 Oct 27 17:33:14.679695 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 220/404] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:14 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:14.701681 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4b207c63-13dd-4878-b39c-65e49916c782 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:14.702294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4b207c63-13dd-4878-b39c-65e49916c782 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:14.708450 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4b207c63-13dd-4878-b39c-65e49916c782 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:14.708935 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4b207c63-13dd-4878-b39c-65e49916c782 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:14.709400 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4b207c63-13dd-4878-b39c-65e49916c782 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:14.710094 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4b207c63-13dd-4878-b39c-65e49916c782 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:14.710550 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4b207c63-13dd-4878-b39c-65e49916c782 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:14.710976 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4b207c63-13dd-4878-b39c-65e49916c782 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:14.846085 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4b207c63-13dd-4878-b39c-65e49916c782 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:14.853746 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4b207c63-13dd-4878-b39c-65e49916c782 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1516 microversion: 2.1 time: 0.155950 Oct 27 17:33:14.854261 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 185/405] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:14 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:15.599012 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1f0fcbff-c7c7-40d7-ba41-e0762971a079 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:15.600525 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-1f0fcbff-c7c7-40d7-ba41-e0762971a079 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:15.606817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1f0fcbff-c7c7-40d7-ba41-e0762971a079 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:15.607301 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1f0fcbff-c7c7-40d7-ba41-e0762971a079 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:15.607828 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1f0fcbff-c7c7-40d7-ba41-e0762971a079 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:15.608534 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1f0fcbff-c7c7-40d7-ba41-e0762971a079 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:15.608995 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1f0fcbff-c7c7-40d7-ba41-e0762971a079 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:15.609422 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1f0fcbff-c7c7-40d7-ba41-e0762971a079 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:15.800250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1f0fcbff-c7c7-40d7-ba41-e0762971a079 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:15.807849 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1f0fcbff-c7c7-40d7-ba41-e0762971a079 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.212751 Oct 27 17:33:15.808420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 221/406] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:15 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:16.831744 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-1517ebd1-0def-460e-999d-7fce653c52a5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:16.832898 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-1517ebd1-0def-460e-999d-7fce653c52a5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:16.839976 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1517ebd1-0def-460e-999d-7fce653c52a5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:16.840497 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1517ebd1-0def-460e-999d-7fce653c52a5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:16.840955 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1517ebd1-0def-460e-999d-7fce653c52a5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:16.841649 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1517ebd1-0def-460e-999d-7fce653c52a5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:16.842590 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1517ebd1-0def-460e-999d-7fce653c52a5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:16.843009 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1517ebd1-0def-460e-999d-7fce653c52a5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:17.003507 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1517ebd1-0def-460e-999d-7fce653c52a5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:17.007698 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=100 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:33:17.014494 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-1517ebd1-0def-460e-999d-7fce653c52a5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1358 microversion: 2.1 time: 0.186190 Oct 27 17:33:17.027741 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 186/407] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:16 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:17.333429 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d809c012-bc07-4a5a-b310-33ac70efcfc1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:33:17.333868 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d809c012-bc07-4a5a-b310-33ac70efcfc1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:17.341194 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d809c012-bc07-4a5a-b310-33ac70efcfc1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:17.342519 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d809c012-bc07-4a5a-b310-33ac70efcfc1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:17.342949 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d809c012-bc07-4a5a-b310-33ac70efcfc1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:17.343646 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d809c012-bc07-4a5a-b310-33ac70efcfc1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:17.344114 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d809c012-bc07-4a5a-b310-33ac70efcfc1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:17.344533 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d809c012-bc07-4a5a-b310-33ac70efcfc1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:17.374244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.objects.instance [None req-d809c012-bc07-4a5a-b310-33ac70efcfc1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lazy-loading 'flavor' on Instance uuid 7238287c-af11-4c20-96cf-8ee9e4b34e8a {{(pid=119047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:33:17.491932 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d809c012-bc07-4a5a-b310-33ac70efcfc1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "POST /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a/action" status: 200 len: 32 microversion: 2.1 time: 0.164283 Oct 27 17:33:17.492850 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 222/408] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Oct 27 17:33:17 2022] POST /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 17:33:17.504119 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-75897847-6ebc-4303-9ec3-92b0cee8c1bb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:17.504731 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-75897847-6ebc-4303-9ec3-92b0cee8c1bb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:17.510717 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-75897847-6ebc-4303-9ec3-92b0cee8c1bb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:17.511202 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-75897847-6ebc-4303-9ec3-92b0cee8c1bb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:17.511647 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-75897847-6ebc-4303-9ec3-92b0cee8c1bb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:17.512384 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-75897847-6ebc-4303-9ec3-92b0cee8c1bb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:17.512832 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-75897847-6ebc-4303-9ec3-92b0cee8c1bb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:17.513247 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-75897847-6ebc-4303-9ec3-92b0cee8c1bb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:17.660486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-75897847-6ebc-4303-9ec3-92b0cee8c1bb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:17.663097 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-75897847-6ebc-4303-9ec3-92b0cee8c1bb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.164279 Oct 27 17:33:17.663656 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 187/409] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:17 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:18.038890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b165e6a1-4cd8-4d4b-a9a5-7ac9ad0f633b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:18.039754 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b165e6a1-4cd8-4d4b-a9a5-7ac9ad0f633b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:18.047574 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b165e6a1-4cd8-4d4b-a9a5-7ac9ad0f633b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:18.048075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b165e6a1-4cd8-4d4b-a9a5-7ac9ad0f633b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:18.048796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b165e6a1-4cd8-4d4b-a9a5-7ac9ad0f633b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:18.049513 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b165e6a1-4cd8-4d4b-a9a5-7ac9ad0f633b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:18.049961 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b165e6a1-4cd8-4d4b-a9a5-7ac9ad0f633b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:18.050385 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b165e6a1-4cd8-4d4b-a9a5-7ac9ad0f633b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:18.183768 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-b165e6a1-4cd8-4d4b-a9a5-7ac9ad0f633b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:18.191501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b165e6a1-4cd8-4d4b-a9a5-7ac9ad0f633b tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1548 microversion: 2.1 time: 0.156871 Oct 27 17:33:18.192157 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 223/410] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:18 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:18.213899 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-23180ef8-e059-471c-9868-45594f41b440 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:18.214509 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-23180ef8-e059-471c-9868-45594f41b440 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:18.221071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-23180ef8-e059-471c-9868-45594f41b440 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:18.221555 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-23180ef8-e059-471c-9868-45594f41b440 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:18.221987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-23180ef8-e059-471c-9868-45594f41b440 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:18.222667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-23180ef8-e059-471c-9868-45594f41b440 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:18.223116 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-23180ef8-e059-471c-9868-45594f41b440 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:18.223537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-23180ef8-e059-471c-9868-45594f41b440 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:18.352864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-23180ef8-e059-471c-9868-45594f41b440 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:18.361590 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-23180ef8-e059-471c-9868-45594f41b440 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1548 microversion: 2.1 time: 0.151463 Oct 27 17:33:18.362419 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 188/411] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:18 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:18.384296 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f704d263-6e49-40b3-8cc3-b728d189da1a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:18.389630 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f704d263-6e49-40b3-8cc3-b728d189da1a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:18.390389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f704d263-6e49-40b3-8cc3-b728d189da1a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Searching by: {'deleted': False, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7'} {{(pid=119047) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 17:33:18.396864 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f704d263-6e49-40b3-8cc3-b728d189da1a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:18.397332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f704d263-6e49-40b3-8cc3-b728d189da1a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:18.397762 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f704d263-6e49-40b3-8cc3-b728d189da1a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:18.398476 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f704d263-6e49-40b3-8cc3-b728d189da1a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:18.398925 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f704d263-6e49-40b3-8cc3-b728d189da1a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:18.399340 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f704d263-6e49-40b3-8cc3-b728d189da1a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:18.491812 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.multi_cell_list [None req-f704d263-6e49-40b3-8cc3-b728d189da1a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119047) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 17:33:18.586666 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f704d263-6e49-40b3-8cc3-b728d189da1a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.206589 Oct 27 17:33:18.587258 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 224/412] 10.222.0.36 () {58 vars in 1125 bytes} [Thu Oct 27 17:33:18 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:33:18.600168 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2e804960-1b3c-4685-ac93-59124517d461 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:18.600769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2e804960-1b3c-4685-ac93-59124517d461 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:18.607134 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e804960-1b3c-4685-ac93-59124517d461 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:18.607666 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e804960-1b3c-4685-ac93-59124517d461 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:18.608165 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e804960-1b3c-4685-ac93-59124517d461 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:18.608844 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e804960-1b3c-4685-ac93-59124517d461 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:18.609288 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e804960-1b3c-4685-ac93-59124517d461 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:18.609705 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2e804960-1b3c-4685-ac93-59124517d461 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:18.687544 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-7e85d9cc-c621-481c-b0c2-efb6cfb39194 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:18.688387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-7e85d9cc-c621-481c-b0c2-efb6cfb39194 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:18.698004 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7e85d9cc-c621-481c-b0c2-efb6cfb39194 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:18.698708 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7e85d9cc-c621-481c-b0c2-efb6cfb39194 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:18.700052 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7e85d9cc-c621-481c-b0c2-efb6cfb39194 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:18.700850 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7e85d9cc-c621-481c-b0c2-efb6cfb39194 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:18.702460 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7e85d9cc-c621-481c-b0c2-efb6cfb39194 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:18.703225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7e85d9cc-c621-481c-b0c2-efb6cfb39194 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:18.764235 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2e804960-1b3c-4685-ac93-59124517d461 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:18.771876 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2e804960-1b3c-4685-ac93-59124517d461 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1548 microversion: 2.1 time: 0.175597 Oct 27 17:33:18.772453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 189/413] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:18 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:18.899811 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7e85d9cc-c621-481c-b0c2-efb6cfb39194 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:18.908664 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-7e85d9cc-c621-481c-b0c2-efb6cfb39194 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.226244 Oct 27 17:33:18.909576 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 225/414] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:18 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:19.934259 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-808e109e-5938-469b-9197-ec6a0bee067e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:19.934871 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-808e109e-5938-469b-9197-ec6a0bee067e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:19.937819 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=54 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:33:19.943420 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-808e109e-5938-469b-9197-ec6a0bee067e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:19.943949 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-808e109e-5938-469b-9197-ec6a0bee067e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:19.944387 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-808e109e-5938-469b-9197-ec6a0bee067e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:19.945073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-808e109e-5938-469b-9197-ec6a0bee067e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:19.945526 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-808e109e-5938-469b-9197-ec6a0bee067e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:19.945945 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-808e109e-5938-469b-9197-ec6a0bee067e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:20.073292 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-808e109e-5938-469b-9197-ec6a0bee067e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:20.080963 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-808e109e-5938-469b-9197-ec6a0bee067e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.150565 Oct 27 17:33:20.081530 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 190/415] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:19 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:21.102886 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-123c525b-2c93-4a2e-97a9-38c14687c7ee tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:21.103414 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-123c525b-2c93-4a2e-97a9-38c14687c7ee tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:21.110210 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-123c525b-2c93-4a2e-97a9-38c14687c7ee tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:21.110678 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-123c525b-2c93-4a2e-97a9-38c14687c7ee tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:21.111103 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-123c525b-2c93-4a2e-97a9-38c14687c7ee tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:21.111800 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-123c525b-2c93-4a2e-97a9-38c14687c7ee tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:21.112244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-123c525b-2c93-4a2e-97a9-38c14687c7ee tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:21.112658 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-123c525b-2c93-4a2e-97a9-38c14687c7ee tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:21.238353 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-123c525b-2c93-4a2e-97a9-38c14687c7ee tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:21.246018 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-123c525b-2c93-4a2e-97a9-38c14687c7ee tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.147051 Oct 27 17:33:21.246574 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 226/416] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:21 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:22.268931 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b6255dfc-1ad3-41b4-8b08-4e221e0d829f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:22.269541 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b6255dfc-1ad3-41b4-8b08-4e221e0d829f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:22.275923 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6255dfc-1ad3-41b4-8b08-4e221e0d829f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:22.276409 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6255dfc-1ad3-41b4-8b08-4e221e0d829f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:22.276837 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6255dfc-1ad3-41b4-8b08-4e221e0d829f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:22.277519 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6255dfc-1ad3-41b4-8b08-4e221e0d829f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:22.277961 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6255dfc-1ad3-41b4-8b08-4e221e0d829f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:22.278378 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6255dfc-1ad3-41b4-8b08-4e221e0d829f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:22.412534 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b6255dfc-1ad3-41b4-8b08-4e221e0d829f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:22.420334 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b6255dfc-1ad3-41b4-8b08-4e221e0d829f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.155059 Oct 27 17:33:22.421060 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 191/417] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:22 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:23.443001 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-db949bb3-036d-4bc9-90c7-099a37944e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:23.443613 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-db949bb3-036d-4bc9-90c7-099a37944e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:23.449628 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-db949bb3-036d-4bc9-90c7-099a37944e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:23.450112 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-db949bb3-036d-4bc9-90c7-099a37944e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:23.450548 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-db949bb3-036d-4bc9-90c7-099a37944e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:23.451898 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-db949bb3-036d-4bc9-90c7-099a37944e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:23.452360 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-db949bb3-036d-4bc9-90c7-099a37944e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:23.452789 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-db949bb3-036d-4bc9-90c7-099a37944e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:23.582412 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-db949bb3-036d-4bc9-90c7-099a37944e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:23.590080 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-db949bb3-036d-4bc9-90c7-099a37944e2d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.151039 Oct 27 17:33:23.590653 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 227/418] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:23 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:24.613777 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d52c9391-d1f0-4cac-a66d-61cad8c5b3fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:24.614390 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d52c9391-d1f0-4cac-a66d-61cad8c5b3fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:24.620853 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d52c9391-d1f0-4cac-a66d-61cad8c5b3fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:24.621327 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d52c9391-d1f0-4cac-a66d-61cad8c5b3fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:24.621759 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d52c9391-d1f0-4cac-a66d-61cad8c5b3fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:24.622440 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d52c9391-d1f0-4cac-a66d-61cad8c5b3fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:24.623534 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d52c9391-d1f0-4cac-a66d-61cad8c5b3fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:24.623980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d52c9391-d1f0-4cac-a66d-61cad8c5b3fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:24.757052 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d52c9391-d1f0-4cac-a66d-61cad8c5b3fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:24.764971 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d52c9391-d1f0-4cac-a66d-61cad8c5b3fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.155067 Oct 27 17:33:24.765587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 192/419] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:24 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:25.633706 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-91978a93-fba8-491e-a66b-0dc1a8e118af tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cc0a793-c90b-4fc7-ab7e-b2a2203d8a2c"}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:33:25.636120 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-91978a93-fba8-491e-a66b-0dc1a8e118af tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:25.642597 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-91978a93-fba8-491e-a66b-0dc1a8e118af tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:25.643076 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-91978a93-fba8-491e-a66b-0dc1a8e118af tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:25.643512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-91978a93-fba8-491e-a66b-0dc1a8e118af tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:25.644226 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-91978a93-fba8-491e-a66b-0dc1a8e118af tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:25.644684 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-91978a93-fba8-491e-a66b-0dc1a8e118af tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:25.645104 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-91978a93-fba8-491e-a66b-0dc1a8e118af tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:25.648875 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:33:25.788386 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-df687958-7d9e-45b8-a9e0-b4253f031b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:25.789003 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-df687958-7d9e-45b8-a9e0-b4253f031b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:25.796080 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-df687958-7d9e-45b8-a9e0-b4253f031b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:25.796557 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-df687958-7d9e-45b8-a9e0-b4253f031b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:25.796981 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-df687958-7d9e-45b8-a9e0-b4253f031b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:25.797729 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-df687958-7d9e-45b8-a9e0-b4253f031b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:25.798235 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-df687958-7d9e-45b8-a9e0-b4253f031b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:25.798691 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-df687958-7d9e-45b8-a9e0-b4253f031b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:25.938456 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-df687958-7d9e-45b8-a9e0-b4253f031b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:25.947007 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-df687958-7d9e-45b8-a9e0-b4253f031b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.162399 Oct 27 17:33:25.947750 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 193/420] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:25 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:25.962136 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-91978a93-fba8-491e-a66b-0dc1a8e118af tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "POST /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332337 Oct 27 17:33:25.965243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 228/421] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Oct 27 17:33:25 2022] POST /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:33:26.971585 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7f66cab9-b942-4792-8f05-293aead025a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:26.972181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7f66cab9-b942-4792-8f05-293aead025a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:26.978822 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f66cab9-b942-4792-8f05-293aead025a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:26.979371 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f66cab9-b942-4792-8f05-293aead025a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:26.979857 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f66cab9-b942-4792-8f05-293aead025a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:26.981177 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f66cab9-b942-4792-8f05-293aead025a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:26.981633 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f66cab9-b942-4792-8f05-293aead025a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:26.982558 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f66cab9-b942-4792-8f05-293aead025a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:27.120822 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7f66cab9-b942-4792-8f05-293aead025a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:27.129407 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7f66cab9-b942-4792-8f05-293aead025a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.161386 Oct 27 17:33:27.129980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 194/422] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:26 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:28.154609 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-afa576bf-4627-44e2-8a19-328f112a8c43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:28.155305 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-afa576bf-4627-44e2-8a19-328f112a8c43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:28.161375 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-afa576bf-4627-44e2-8a19-328f112a8c43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:28.161855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-afa576bf-4627-44e2-8a19-328f112a8c43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:28.162292 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-afa576bf-4627-44e2-8a19-328f112a8c43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:28.162970 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-afa576bf-4627-44e2-8a19-328f112a8c43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:28.163420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-afa576bf-4627-44e2-8a19-328f112a8c43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:28.163877 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-afa576bf-4627-44e2-8a19-328f112a8c43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:28.290102 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-afa576bf-4627-44e2-8a19-328f112a8c43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:28.297786 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-afa576bf-4627-44e2-8a19-328f112a8c43 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.148378 Oct 27 17:33:28.298357 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 229/423] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:28 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:29.321049 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a00e9c74-0c08-4bf5-a2b9-523a5c8eae7d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:29.321657 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a00e9c74-0c08-4bf5-a2b9-523a5c8eae7d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:29.328697 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a00e9c74-0c08-4bf5-a2b9-523a5c8eae7d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:29.329173 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a00e9c74-0c08-4bf5-a2b9-523a5c8eae7d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:29.329606 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a00e9c74-0c08-4bf5-a2b9-523a5c8eae7d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:29.330282 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a00e9c74-0c08-4bf5-a2b9-523a5c8eae7d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:29.330724 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a00e9c74-0c08-4bf5-a2b9-523a5c8eae7d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:29.331144 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a00e9c74-0c08-4bf5-a2b9-523a5c8eae7d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:29.455984 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a00e9c74-0c08-4bf5-a2b9-523a5c8eae7d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:29.463544 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a00e9c74-0c08-4bf5-a2b9-523a5c8eae7d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.146971 Oct 27 17:33:29.464132 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 195/424] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:29 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:30.485346 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d2b2c8f7-2b58-48f0-9aed-94f82c0360cc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:30.485882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d2b2c8f7-2b58-48f0-9aed-94f82c0360cc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:30.488262 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:33:30.493649 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d2b2c8f7-2b58-48f0-9aed-94f82c0360cc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:30.494120 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d2b2c8f7-2b58-48f0-9aed-94f82c0360cc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:30.494549 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d2b2c8f7-2b58-48f0-9aed-94f82c0360cc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:30.495224 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d2b2c8f7-2b58-48f0-9aed-94f82c0360cc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:30.495701 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d2b2c8f7-2b58-48f0-9aed-94f82c0360cc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:30.496143 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d2b2c8f7-2b58-48f0-9aed-94f82c0360cc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:30.623377 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d2b2c8f7-2b58-48f0-9aed-94f82c0360cc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:30.630922 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d2b2c8f7-2b58-48f0-9aed-94f82c0360cc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.149443 Oct 27 17:33:30.631483 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 230/425] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:30 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:31.654609 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-90177fe8-2df4-45e5-ba7a-c05535c098ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:31.655322 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-90177fe8-2df4-45e5-ba7a-c05535c098ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:31.662084 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90177fe8-2df4-45e5-ba7a-c05535c098ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:31.662573 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90177fe8-2df4-45e5-ba7a-c05535c098ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:31.663010 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90177fe8-2df4-45e5-ba7a-c05535c098ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:31.663779 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90177fe8-2df4-45e5-ba7a-c05535c098ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:31.664180 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90177fe8-2df4-45e5-ba7a-c05535c098ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:31.664630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90177fe8-2df4-45e5-ba7a-c05535c098ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:31.796240 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-90177fe8-2df4-45e5-ba7a-c05535c098ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:31.804095 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-90177fe8-2df4-45e5-ba7a-c05535c098ef tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.153919 Oct 27 17:33:31.804748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 196/426] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:31 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:32.826900 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5ffdca77-5d14-4a01-b250-c4251dc073d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:32.827510 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-5ffdca77-5d14-4a01-b250-c4251dc073d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:32.833917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5ffdca77-5d14-4a01-b250-c4251dc073d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:32.834450 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5ffdca77-5d14-4a01-b250-c4251dc073d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:32.834871 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5ffdca77-5d14-4a01-b250-c4251dc073d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:32.835557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5ffdca77-5d14-4a01-b250-c4251dc073d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:32.836092 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5ffdca77-5d14-4a01-b250-c4251dc073d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:32.836522 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5ffdca77-5d14-4a01-b250-c4251dc073d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:32.969705 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-5ffdca77-5d14-4a01-b250-c4251dc073d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:32.977352 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5ffdca77-5d14-4a01-b250-c4251dc073d3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.154875 Oct 27 17:33:32.977911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 231/427] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:32 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:33.999470 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8ed42a65-7db2-44a5-9c03-8abead9a9e2c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:34.000103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8ed42a65-7db2-44a5-9c03-8abead9a9e2c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:34.006439 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ed42a65-7db2-44a5-9c03-8abead9a9e2c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:34.006921 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ed42a65-7db2-44a5-9c03-8abead9a9e2c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:34.007346 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ed42a65-7db2-44a5-9c03-8abead9a9e2c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:34.008055 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ed42a65-7db2-44a5-9c03-8abead9a9e2c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:34.008530 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ed42a65-7db2-44a5-9c03-8abead9a9e2c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:34.008947 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ed42a65-7db2-44a5-9c03-8abead9a9e2c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:34.141877 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8ed42a65-7db2-44a5-9c03-8abead9a9e2c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:34.149628 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8ed42a65-7db2-44a5-9c03-8abead9a9e2c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.154050 Oct 27 17:33:34.150191 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 197/428] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:33 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:34.620268 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c1247875-136b-472f-b673-7fa6179fc211 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:34.621189 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c1247875-136b-472f-b673-7fa6179fc211 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:34.628088 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c1247875-136b-472f-b673-7fa6179fc211 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:34.628565 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c1247875-136b-472f-b673-7fa6179fc211 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:34.628992 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c1247875-136b-472f-b673-7fa6179fc211 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:34.629672 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c1247875-136b-472f-b673-7fa6179fc211 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:34.630146 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c1247875-136b-472f-b673-7fa6179fc211 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:34.630561 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c1247875-136b-472f-b673-7fa6179fc211 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:34.762331 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c1247875-136b-472f-b673-7fa6179fc211 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:34.771147 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c1247875-136b-472f-b673-7fa6179fc211 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1594 microversion: 2.1 time: 0.154670 Oct 27 17:33:34.771832 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 232/429] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:34 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:35.173261 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-67622c02-0b2b-4787-8e29-aca4c0019bdb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:35.173991 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-67622c02-0b2b-4787-8e29-aca4c0019bdb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:35.180433 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67622c02-0b2b-4787-8e29-aca4c0019bdb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:35.180998 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67622c02-0b2b-4787-8e29-aca4c0019bdb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:35.181525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67622c02-0b2b-4787-8e29-aca4c0019bdb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:35.182274 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67622c02-0b2b-4787-8e29-aca4c0019bdb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:35.182721 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67622c02-0b2b-4787-8e29-aca4c0019bdb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:35.183136 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67622c02-0b2b-4787-8e29-aca4c0019bdb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:35.313062 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-67622c02-0b2b-4787-8e29-aca4c0019bdb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:35.321985 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-67622c02-0b2b-4787-8e29-aca4c0019bdb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.152913 Oct 27 17:33:35.322729 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 198/430] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:35 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:36.345170 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-cac7dc17-28d8-44d3-a481-9bdaece27747 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:36.345885 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-cac7dc17-28d8-44d3-a481-9bdaece27747 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:36.352804 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cac7dc17-28d8-44d3-a481-9bdaece27747 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:36.353359 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cac7dc17-28d8-44d3-a481-9bdaece27747 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:36.353835 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cac7dc17-28d8-44d3-a481-9bdaece27747 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:36.354699 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cac7dc17-28d8-44d3-a481-9bdaece27747 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:36.355562 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cac7dc17-28d8-44d3-a481-9bdaece27747 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:36.356024 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cac7dc17-28d8-44d3-a481-9bdaece27747 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:36.602725 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-cac7dc17-28d8-44d3-a481-9bdaece27747 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:36.611219 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-cac7dc17-28d8-44d3-a481-9bdaece27747 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.270113 Oct 27 17:33:36.611815 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 233/431] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:36 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:37.027484 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-1be2b390-bd29-472d-9647-30111f43a0f3 req-c7e2fbab-35a0-4be8-a270-d401edfbd657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95000566-a99d-4dc8-b509-bc86de3e8743", "tag": "e5243648-b4fa-47b1-96eb-9bf82da1c364"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:33:37.041404 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-1be2b390-bd29-472d-9647-30111f43a0f3 req-c7e2fbab-35a0-4be8-a270-d401edfbd657 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:37.042354 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-1be2b390-bd29-472d-9647-30111f43a0f3 req-c7e2fbab-35a0-4be8-a270-d401edfbd657 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:37.042787 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-1be2b390-bd29-472d-9647-30111f43a0f3 req-c7e2fbab-35a0-4be8-a270-d401edfbd657 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:37.057954 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-1be2b390-bd29-472d-9647-30111f43a0f3 req-c7e2fbab-35a0-4be8-a270-d401edfbd657 service nova] Creating event network-changed:e5243648-b4fa-47b1-96eb-9bf82da1c364 for instance 95000566-a99d-4dc8-b509-bc86de3e8743 on hv-cinder-86283 Oct 27 17:33:37.064071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-1be2b390-bd29-472d-9647-30111f43a0f3 req-c7e2fbab-35a0-4be8-a270-d401edfbd657 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041303 Oct 27 17:33:37.065020 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 199/432] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:33:37.635021 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b1052f78-70a9-4010-aba3-b5a1654b1e07 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:37.635762 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b1052f78-70a9-4010-aba3-b5a1654b1e07 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:37.646992 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b1052f78-70a9-4010-aba3-b5a1654b1e07 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:37.647558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b1052f78-70a9-4010-aba3-b5a1654b1e07 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:37.648051 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b1052f78-70a9-4010-aba3-b5a1654b1e07 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:37.649700 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b1052f78-70a9-4010-aba3-b5a1654b1e07 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:37.650151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b1052f78-70a9-4010-aba3-b5a1654b1e07 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:37.651260 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b1052f78-70a9-4010-aba3-b5a1654b1e07 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:37.803328 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-b1052f78-70a9-4010-aba3-b5a1654b1e07 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:37.813058 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b1052f78-70a9-4010-aba3-b5a1654b1e07 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.182594 Oct 27 17:33:37.820658 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 234/433] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:37 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:37.979738 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a5aaa5c4-d308-4fc6-a83f-4cfed6f82c54 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-61907169"}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:33:37.980632 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a5aaa5c4-d308-4fc6-a83f-4cfed6f82c54 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:37.988487 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a5aaa5c4-d308-4fc6-a83f-4cfed6f82c54 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:37.989002 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a5aaa5c4-d308-4fc6-a83f-4cfed6f82c54 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:37.989435 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a5aaa5c4-d308-4fc6-a83f-4cfed6f82c54 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:37.990286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a5aaa5c4-d308-4fc6-a83f-4cfed6f82c54 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:37.990751 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a5aaa5c4-d308-4fc6-a83f-4cfed6f82c54 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:37.991169 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a5aaa5c4-d308-4fc6-a83f-4cfed6f82c54 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:38.191574 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.network.security_group_api [None req-a5aaa5c4-d308-4fc6-a83f-4cfed6f82c54 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Adding security group d243046f-b977-4927-92f4-611cc7de1cc9 to port e5243648-b4fa-47b1-96eb-9bf82da1c364 Oct 27 17:33:38.656839 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a5aaa5c4-d308-4fc6-a83f-4cfed6f82c54 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "POST /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/action" status: 202 len: 0 microversion: 2.1 time: 0.681913 Oct 27 17:33:38.657450 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 200/434] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Oct 27 17:33:37 2022] POST /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:33:38.665574 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-718ce82e-f7d3-4c9c-bec2-1c3b42f2faf1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:38.666329 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-42ec6be2-cf6b-4dc2-b21e-ec468137853d req-b42705ec-faa7-450b-96cf-ecb6d3f63337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95000566-a99d-4dc8-b509-bc86de3e8743", "tag": "e5243648-b4fa-47b1-96eb-9bf82da1c364"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:33:38.666624 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-718ce82e-f7d3-4c9c-bec2-1c3b42f2faf1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:38.673654 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-718ce82e-f7d3-4c9c-bec2-1c3b42f2faf1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:38.674262 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-718ce82e-f7d3-4c9c-bec2-1c3b42f2faf1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:38.674816 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-718ce82e-f7d3-4c9c-bec2-1c3b42f2faf1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:38.675668 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-718ce82e-f7d3-4c9c-bec2-1c3b42f2faf1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:38.676237 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-42ec6be2-cf6b-4dc2-b21e-ec468137853d req-b42705ec-faa7-450b-96cf-ecb6d3f63337 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:38.676359 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-718ce82e-f7d3-4c9c-bec2-1c3b42f2faf1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:38.676716 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-42ec6be2-cf6b-4dc2-b21e-ec468137853d req-b42705ec-faa7-450b-96cf-ecb6d3f63337 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:38.677081 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-718ce82e-f7d3-4c9c-bec2-1c3b42f2faf1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:38.677189 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-42ec6be2-cf6b-4dc2-b21e-ec468137853d req-b42705ec-faa7-450b-96cf-ecb6d3f63337 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:38.693516 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-42ec6be2-cf6b-4dc2-b21e-ec468137853d req-b42705ec-faa7-450b-96cf-ecb6d3f63337 service nova] Creating event network-changed:e5243648-b4fa-47b1-96eb-9bf82da1c364 for instance 95000566-a99d-4dc8-b509-bc86de3e8743 on hv-cinder-86283 Oct 27 17:33:38.698912 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-42ec6be2-cf6b-4dc2-b21e-ec468137853d req-b42705ec-faa7-450b-96cf-ecb6d3f63337 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035811 Oct 27 17:33:38.699732 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 201/435] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:33:38.833066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-718ce82e-f7d3-4c9c-bec2-1c3b42f2faf1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:38.838360 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7d0b732c-234e-4b07-903d-4734f05084c0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:38.839151 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7d0b732c-234e-4b07-903d-4734f05084c0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:38.843497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-718ce82e-f7d3-4c9c-bec2-1c3b42f2faf1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1639 microversion: 2.1 time: 0.181834 Oct 27 17:33:38.844117 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 235/436] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:38 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1639 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:38.846103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7d0b732c-234e-4b07-903d-4734f05084c0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:38.846589 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7d0b732c-234e-4b07-903d-4734f05084c0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:38.847025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7d0b732c-234e-4b07-903d-4734f05084c0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:38.847808 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7d0b732c-234e-4b07-903d-4734f05084c0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:38.848201 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7d0b732c-234e-4b07-903d-4734f05084c0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:38.848625 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7d0b732c-234e-4b07-903d-4734f05084c0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:38.983360 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7d0b732c-234e-4b07-903d-4734f05084c0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:38.991101 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7d0b732c-234e-4b07-903d-4734f05084c0 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.156932 Oct 27 17:33:38.991668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 202/437] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:38 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:33:40.015878 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-15279b52-c34b-4175-8c76-94d38b4872fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:40.016494 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-15279b52-c34b-4175-8c76-94d38b4872fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:40.022818 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15279b52-c34b-4175-8c76-94d38b4872fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:40.023306 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15279b52-c34b-4175-8c76-94d38b4872fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:40.023765 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15279b52-c34b-4175-8c76-94d38b4872fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:40.024465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15279b52-c34b-4175-8c76-94d38b4872fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:40.024917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15279b52-c34b-4175-8c76-94d38b4872fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:40.025340 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15279b52-c34b-4175-8c76-94d38b4872fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:40.150536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-15279b52-c34b-4175-8c76-94d38b4872fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:40.158196 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-15279b52-c34b-4175-8c76-94d38b4872fd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1502 microversion: 2.1 time: 0.146986 Oct 27 17:33:40.158767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 236/438] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:40 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:40.180700 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-99527aba-3df5-4751-9774-165435134840 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94216703-2a05-48b2-a68e-38e6941fbfc6"}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:33:40.183146 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-99527aba-3df5-4751-9774-165435134840 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:40.190151 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-99527aba-3df5-4751-9774-165435134840 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:40.190627 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-99527aba-3df5-4751-9774-165435134840 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:40.191059 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-99527aba-3df5-4751-9774-165435134840 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:40.191757 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-99527aba-3df5-4751-9774-165435134840 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:40.192210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-99527aba-3df5-4751-9774-165435134840 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:40.192629 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-99527aba-3df5-4751-9774-165435134840 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:40.215669 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-99527aba-3df5-4751-9774-165435134840 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] HTTP exception thrown: Cannot 'attach_volume' instance 7238287c-af11-4c20-96cf-8ee9e4b34e8a while it is in vm_state rescued Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-99527aba-3df5-4751-9774-165435134840 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Request method failure captured: Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: POST /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a/os-volume_attachments HTTP/1.1 Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 74 Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA6QQ2Xe-RueSZa98b1WeX08eTwljkpEVfpwUa3_6OScj4PL9zKGISZTxFfRUWVHCjOh7d01WrvQG15DDLAs0QSPfgfc14moQRiXavFZxgaAAOcGU4FOVDxLJFAwl_ReXyMnJxpnmS-6FQDky2vh8WzLt57pts-AbYVWOip7qcpMPc Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: e29292a8f0184800a931a0cbd8c72bf8 Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1280306624 Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:33:40.217421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:33:40.218769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e29292a8f0184800a931a0cbd8c72bf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e29292a8f0184800a931a0cbd8c72bf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e29292a8f0184800a931a0cbd8c72bf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e29292a8f0184800a931a0cbd8c72bf8"}]}] Oct 27 17:33:40.218769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1280306624 Oct 27 17:33:40.218769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: e29292a8f0184800a931a0cbd8c72bf8 Oct 27 17:33:40.218769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1280306624 Oct 27 17:33:40.218769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-ServerRescueNegativeTestJSON-1280306624-project Oct 27 17:33:40.218769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:33:40.218769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:33:40.218769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 8c8a2448e10b4ff39adf43a9581cb794 Oct 27 17:33:40.218769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1280306624-project Oct 27 17:33:40.218769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Oct 27 17:33:40.218769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {"volumeAttachment": {"volumeId": "94216703-2a05-48b2-a68e-38e6941fbfc6"}} Oct 27 17:33:40.218769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Cannot 'attach_volume' instance 7238287c-af11-4c20-96cf-8ee9e4b34e8a while it is in vm_state rescued Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'server_id': '7238287c-af11-4c20-96cf-8ee9e4b34e8a', 'body': {'volumeAttachment': {'volumeId': '94216703-2a05-48b2-a68e-38e6941fbfc6'}}} Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7238287c-af11-4c20-96cf-8ee9e4b34e8a in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:33:40.219525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7238287c-af11-4c20-96cf-8ee9e4b34e8a while it is in vm_state rescued Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:33:40.220737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:33:40.221948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:33:40.221948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:33:40.221948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7238287c-af11-4c20-96cf-8ee9e4b34e8a while it is in vm_state rescued Oct 27 17:33:40.221948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:33:40.221948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-99527aba-3df5-4751-9774-165435134840 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Returning 409 to user: Cannot 'attach_volume' instance 7238287c-af11-4c20-96cf-8ee9e4b34e8a while it is in vm_state rescued {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:33:40.221948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-99527aba-3df5-4751-9774-165435134840 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "POST /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042191 Oct 27 17:33:40.221948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 203/439] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Oct 27 17:33:40 2022] POST /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 17:33:40.228025 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b0b22390-33d0-4557-8199-992e3247871e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:33:40.228563 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b0b22390-33d0-4557-8199-992e3247871e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:40.235249 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b0b22390-33d0-4557-8199-992e3247871e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:40.235777 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b0b22390-33d0-4557-8199-992e3247871e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:40.236217 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b0b22390-33d0-4557-8199-992e3247871e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:40.236912 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b0b22390-33d0-4557-8199-992e3247871e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:40.237369 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b0b22390-33d0-4557-8199-992e3247871e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:40.237797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b0b22390-33d0-4557-8199-992e3247871e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:40.304718 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b0b22390-33d0-4557-8199-992e3247871e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "POST /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a/action" status: 202 len: 0 microversion: 2.1 time: 0.080406 Oct 27 17:33:40.305505 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 237/440] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Oct 27 17:33:40 2022] POST /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:33:40.314272 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d659d4f3-5abf-4ba6-ab98-819b4b0c8604 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:40.315059 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d659d4f3-5abf-4ba6-ab98-819b4b0c8604 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:40.321227 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d659d4f3-5abf-4ba6-ab98-819b4b0c8604 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:40.321803 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d659d4f3-5abf-4ba6-ab98-819b4b0c8604 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:40.322346 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d659d4f3-5abf-4ba6-ab98-819b4b0c8604 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:40.323260 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d659d4f3-5abf-4ba6-ab98-819b4b0c8604 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:40.323842 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d659d4f3-5abf-4ba6-ab98-819b4b0c8604 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:40.324404 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d659d4f3-5abf-4ba6-ab98-819b4b0c8604 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:40.455956 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d659d4f3-5abf-4ba6-ab98-819b4b0c8604 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:40.463538 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d659d4f3-5abf-4ba6-ab98-819b4b0c8604 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1510 microversion: 2.1 time: 0.153639 Oct 27 17:33:40.464125 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 204/441] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:40 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:41.487145 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5dd081e9-4982-4328-ae8a-cd491f5d040c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:41.487790 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-5dd081e9-4982-4328-ae8a-cd491f5d040c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:41.494393 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5dd081e9-4982-4328-ae8a-cd491f5d040c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:41.494879 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5dd081e9-4982-4328-ae8a-cd491f5d040c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:41.495331 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5dd081e9-4982-4328-ae8a-cd491f5d040c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:41.496043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5dd081e9-4982-4328-ae8a-cd491f5d040c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:41.496498 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5dd081e9-4982-4328-ae8a-cd491f5d040c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:41.496921 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5dd081e9-4982-4328-ae8a-cd491f5d040c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:41.623208 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-5dd081e9-4982-4328-ae8a-cd491f5d040c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:41.631084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5dd081e9-4982-4328-ae8a-cd491f5d040c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1510 microversion: 2.1 time: 0.148875 Oct 27 17:33:41.631687 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 238/442] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:41 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:42.655124 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ba4cb216-5c3a-43c6-a98d-a1034936ce58 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:42.655752 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ba4cb216-5c3a-43c6-a98d-a1034936ce58 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:42.661982 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ba4cb216-5c3a-43c6-a98d-a1034936ce58 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:42.662467 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ba4cb216-5c3a-43c6-a98d-a1034936ce58 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:42.662901 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ba4cb216-5c3a-43c6-a98d-a1034936ce58 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:42.663593 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ba4cb216-5c3a-43c6-a98d-a1034936ce58 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:42.664078 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ba4cb216-5c3a-43c6-a98d-a1034936ce58 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:42.664504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ba4cb216-5c3a-43c6-a98d-a1034936ce58 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:42.684695 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=100 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:33:42.796263 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ba4cb216-5c3a-43c6-a98d-a1034936ce58 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:42.804028 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ba4cb216-5c3a-43c6-a98d-a1034936ce58 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1510 microversion: 2.1 time: 0.152767 Oct 27 17:33:42.804594 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 205/443] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:42 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:43.826423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-63740f4c-cf26-4fe7-a33a-ea9cf33902ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:43.827027 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-63740f4c-cf26-4fe7-a33a-ea9cf33902ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:43.833319 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63740f4c-cf26-4fe7-a33a-ea9cf33902ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:43.833802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63740f4c-cf26-4fe7-a33a-ea9cf33902ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:43.834227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63740f4c-cf26-4fe7-a33a-ea9cf33902ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:43.834911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63740f4c-cf26-4fe7-a33a-ea9cf33902ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:43.836270 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63740f4c-cf26-4fe7-a33a-ea9cf33902ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:43.836697 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63740f4c-cf26-4fe7-a33a-ea9cf33902ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:43.968974 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-63740f4c-cf26-4fe7-a33a-ea9cf33902ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:43.976620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-63740f4c-cf26-4fe7-a33a-ea9cf33902ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1510 microversion: 2.1 time: 0.154102 Oct 27 17:33:43.977212 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 239/444] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:43 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:45.000387 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-280e8454-a849-413e-a797-5ece86ae1558 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:45.000999 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-280e8454-a849-413e-a797-5ece86ae1558 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:45.007307 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-280e8454-a849-413e-a797-5ece86ae1558 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:45.007831 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-280e8454-a849-413e-a797-5ece86ae1558 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:45.008488 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-280e8454-a849-413e-a797-5ece86ae1558 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:45.009153 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-280e8454-a849-413e-a797-5ece86ae1558 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:45.009725 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-280e8454-a849-413e-a797-5ece86ae1558 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:45.010216 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-280e8454-a849-413e-a797-5ece86ae1558 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:45.138662 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-280e8454-a849-413e-a797-5ece86ae1558 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:45.146302 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-280e8454-a849-413e-a797-5ece86ae1558 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1510 microversion: 2.1 time: 0.150481 Oct 27 17:33:45.146861 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 206/445] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:44 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:46.169949 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-712cd812-05d4-4ec5-b84f-c225dcc36f64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:46.170497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-712cd812-05d4-4ec5-b84f-c225dcc36f64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:46.172880 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=42 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:33:46.178341 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-712cd812-05d4-4ec5-b84f-c225dcc36f64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:46.178821 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-712cd812-05d4-4ec5-b84f-c225dcc36f64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:46.179251 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-712cd812-05d4-4ec5-b84f-c225dcc36f64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:46.179957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-712cd812-05d4-4ec5-b84f-c225dcc36f64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:46.180401 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-712cd812-05d4-4ec5-b84f-c225dcc36f64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:46.180816 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-712cd812-05d4-4ec5-b84f-c225dcc36f64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:46.311796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-712cd812-05d4-4ec5-b84f-c225dcc36f64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:46.319330 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-712cd812-05d4-4ec5-b84f-c225dcc36f64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1510 microversion: 2.1 time: 0.153826 Oct 27 17:33:46.319925 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 240/446] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:46 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:47.342382 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4493bf7e-4900-47eb-a53a-b9f4f15c7f82 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:47.342986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4493bf7e-4900-47eb-a53a-b9f4f15c7f82 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:47.349433 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4493bf7e-4900-47eb-a53a-b9f4f15c7f82 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:47.349908 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4493bf7e-4900-47eb-a53a-b9f4f15c7f82 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:47.350337 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4493bf7e-4900-47eb-a53a-b9f4f15c7f82 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:47.351043 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4493bf7e-4900-47eb-a53a-b9f4f15c7f82 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:47.351491 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4493bf7e-4900-47eb-a53a-b9f4f15c7f82 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:47.351945 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4493bf7e-4900-47eb-a53a-b9f4f15c7f82 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:47.480476 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4493bf7e-4900-47eb-a53a-b9f4f15c7f82 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:47.488129 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4493bf7e-4900-47eb-a53a-b9f4f15c7f82 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1510 microversion: 2.1 time: 0.149572 Oct 27 17:33:47.488687 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 207/447] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:47 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:48.511084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a7ff5023-9972-4a78-a1a0-c6f59dbd3d5f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:48.511725 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a7ff5023-9972-4a78-a1a0-c6f59dbd3d5f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:48.518260 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7ff5023-9972-4a78-a1a0-c6f59dbd3d5f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:48.518744 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7ff5023-9972-4a78-a1a0-c6f59dbd3d5f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:48.519177 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7ff5023-9972-4a78-a1a0-c6f59dbd3d5f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:48.519894 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7ff5023-9972-4a78-a1a0-c6f59dbd3d5f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:48.520346 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7ff5023-9972-4a78-a1a0-c6f59dbd3d5f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:48.520764 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7ff5023-9972-4a78-a1a0-c6f59dbd3d5f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:48.651169 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a7ff5023-9972-4a78-a1a0-c6f59dbd3d5f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:48.659026 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a7ff5023-9972-4a78-a1a0-c6f59dbd3d5f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1516 microversion: 2.1 time: 0.151846 Oct 27 17:33:48.659627 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 241/448] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:48 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:50.038012 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-c7e8cb5b-265a-4ceb-943e-7ab44d71731b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Action: 'create', calling method: .version_select at 0x7f078877d5e0>, body: {"keypair": {"name": "tempest-keypair-1746470297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVC9AmnQlEbg3i1PCaNvmiH2ZBfDu/sClAMeVkFUJf9uTZf9bdIOlCsQ1TURUHdlg2K0FEHYgUiudBrb19pFd7XdHmzUkCB8qMYq2+ANGIj0YP+VQv4j5EjOx1rGTiBIg=="}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:33:50.045038 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 17:33:50.045197 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Thu Oct 27 17:33:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.36) !!! Oct 27 17:33:50.046995 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=36 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:33:50.066302 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-c7e8cb5b-265a-4ceb-943e-7ab44d71731b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Getting quotas for project e29292a8f0184800a931a0cbd8c72bf8. Resources: {'key_pairs'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:33:50.070316 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-c7e8cb5b-265a-4ceb-943e-7ab44d71731b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Getting quotas for user 8c8a2448e10b4ff39adf43a9581cb794 and project e29292a8f0184800a931a0cbd8c72bf8. Resources: {'key_pairs'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:33:50.097664 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-c7e8cb5b-265a-4ceb-943e-7ab44d71731b tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063292 Oct 27 17:33:50.098369 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 208/449] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Oct 27 17:33:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:33:51.416481 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-899380376", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1141f554-a530-4b9e-acf6-75096dad10e5"}], "security_groups": [{"name": "tempest-securitygroup--780603343"}], "key_name": "tempest-keypair-1746470297", "user_data": "}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:33:51.524440 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.network.neutron [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] validate_networks() for [('1141f554-a530-4b9e-acf6-75096dad10e5', None, None, None, None, None)] {{(pid=119047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:33:51.946592 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Flavor limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:33:51.947324 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Image limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:33:51.947965 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Flavor pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:33:51.948499 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Image pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:33:51.949047 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:33:51.958243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:51.959033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:51.959518 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:51.960523 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:51.961174 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:51.961774 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:51.980697 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Getting quotas for project e29292a8f0184800a931a0cbd8c72bf8. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:33:51.985797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Getting quotas for user 8c8a2448e10b4ff39adf43a9581cb794 and project e29292a8f0184800a931a0cbd8c72bf8. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:33:51.997436 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Going to run 1 instances... {{(pid=119047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:33:51.999812 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:33:52.047477 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR oslo.messaging._drivers.impl_rabbit [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [c752b25c-738c-4f5b-8238-3c85339ebd11] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 17:33:53.058164 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO oslo.messaging._drivers.impl_rabbit [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [c752b25c-738c-4f5b-8238-3c85339ebd11] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 47590. Oct 27 17:33:53.064634 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-80c1a327-c319-4c77-a18c-05c5627c94dc tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.653100 Oct 27 17:33:53.065510 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 242/450] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:33:51 2022] POST /compute/v2.1/servers => generated 408 bytes in 1655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:33:53.076479 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ef69fc45-7c33-466a-b16a-317e6d14f841 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:53.077868 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ef69fc45-7c33-466a-b16a-317e6d14f841 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:53.145228 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ef69fc45-7c33-466a-b16a-317e6d14f841 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:53.153605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ef69fc45-7c33-466a-b16a-317e6d14f841 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1245 microversion: 2.1 time: 0.080830 Oct 27 17:33:53.154774 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 209/451] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:53 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:54.182411 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-065b7879-67c8-4b9d-9a27-100b6ae53192 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:54.184099 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-065b7879-67c8-4b9d-9a27-100b6ae53192 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:54.276286 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-065b7879-67c8-4b9d-9a27-100b6ae53192 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:54.284078 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-065b7879-67c8-4b9d-9a27-100b6ae53192 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1245 microversion: 2.1 time: 0.106435 Oct 27 17:33:54.284771 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 243/452] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:54 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1245 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:55.308689 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-99fbe1ed-7c1a-4ccc-bed6-eb4c00df6b24 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:55.309453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-99fbe1ed-7c1a-4ccc-bed6-eb4c00df6b24 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:55.391983 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-99fbe1ed-7c1a-4ccc-bed6-eb4c00df6b24 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:55.403407 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-99fbe1ed-7c1a-4ccc-bed6-eb4c00df6b24 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1245 microversion: 2.1 time: 0.100649 Oct 27 17:33:55.404830 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 210/453] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:55 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:56.427471 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6f5f9a4f-ad44-483c-9440-be9e1a20d5a4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:56.428791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-6f5f9a4f-ad44-483c-9440-be9e1a20d5a4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:56.519347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-6f5f9a4f-ad44-483c-9440-be9e1a20d5a4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:56.527169 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6f5f9a4f-ad44-483c-9440-be9e1a20d5a4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1245 microversion: 2.1 time: 0.103466 Oct 27 17:33:56.528999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 244/454] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:56 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:57.550528 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f4c03abc-86bd-42d5-99ea-13e928d80c73 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:57.551790 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-f4c03abc-86bd-42d5-99ea-13e928d80c73 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:57.558765 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=14 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:33:57.561890 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4c03abc-86bd-42d5-99ea-13e928d80c73 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:57.562414 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4c03abc-86bd-42d5-99ea-13e928d80c73 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:57.563266 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4c03abc-86bd-42d5-99ea-13e928d80c73 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:57.563701 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4c03abc-86bd-42d5-99ea-13e928d80c73 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:57.564206 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4c03abc-86bd-42d5-99ea-13e928d80c73 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:57.564634 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4c03abc-86bd-42d5-99ea-13e928d80c73 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:57.628136 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f4c03abc-86bd-42d5-99ea-13e928d80c73 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:57.644872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f4c03abc-86bd-42d5-99ea-13e928d80c73 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1249 microversion: 2.1 time: 0.098253 Oct 27 17:33:57.645947 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 211/455] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:57 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1249 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:58.676583 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ad99fea7-a202-4897-aa31-c64ee9e7dd95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:58.677457 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-ad99fea7-a202-4897-aa31-c64ee9e7dd95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:58.691022 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ad99fea7-a202-4897-aa31-c64ee9e7dd95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:58.691546 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ad99fea7-a202-4897-aa31-c64ee9e7dd95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:58.692064 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ad99fea7-a202-4897-aa31-c64ee9e7dd95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:58.692977 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ad99fea7-a202-4897-aa31-c64ee9e7dd95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:58.693594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ad99fea7-a202-4897-aa31-c64ee9e7dd95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:58.694470 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ad99fea7-a202-4897-aa31-c64ee9e7dd95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:58.700409 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:33:58.793166 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ad99fea7-a202-4897-aa31-c64ee9e7dd95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:58.807041 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-ad99fea7-a202-4897-aa31-c64ee9e7dd95 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1297 microversion: 2.1 time: 0.135746 Oct 27 17:33:58.808499 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 245/456] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:58 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1297 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:33:59.832459 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9752c423-b5d3-4dc1-9c8f-cc6fe4acb8cd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:33:59.833061 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9752c423-b5d3-4dc1-9c8f-cc6fe4acb8cd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:33:59.842687 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9752c423-b5d3-4dc1-9c8f-cc6fe4acb8cd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:59.843410 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9752c423-b5d3-4dc1-9c8f-cc6fe4acb8cd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:59.844052 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9752c423-b5d3-4dc1-9c8f-cc6fe4acb8cd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:59.845113 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9752c423-b5d3-4dc1-9c8f-cc6fe4acb8cd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:33:59.845719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9752c423-b5d3-4dc1-9c8f-cc6fe4acb8cd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:33:59.852228 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9752c423-b5d3-4dc1-9c8f-cc6fe4acb8cd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:33:59.967230 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9752c423-b5d3-4dc1-9c8f-cc6fe4acb8cd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:33:59.975436 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9752c423-b5d3-4dc1-9c8f-cc6fe4acb8cd tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1303 microversion: 2.1 time: 0.146766 Oct 27 17:33:59.980316 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 212/457] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:33:59 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1303 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:00.420527 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5a50cd8c-c2be-4932-b5ad-90181d63b7cf tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Action: 'create', calling method: .version_select at 0x7f07886be160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1230701945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfOPPNZzTzgAWAuv3W+zwvIWHJGg3idjDUX4d9zH72jKHqVFUkSJPJprdLhp67mi9Vw3x+NLOIkHshiGIJnfD/hFPq1ODVIUDfBSrdBPV6OkMRTUq+7cxvFo2i1zkY7Hg=="}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:00.446586 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-5a50cd8c-c2be-4932-b5ad-90181d63b7cf tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Getting quotas for project d8c77f9e29f141c7b5a02d8b7eb62da3. Resources: {'key_pairs'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:34:00.451865 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-5a50cd8c-c2be-4932-b5ad-90181d63b7cf tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Getting quotas for user 76c92a21193a43e4838e625f2d2e4dd5 and project d8c77f9e29f141c7b5a02d8b7eb62da3. Resources: {'key_pairs'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:34:00.491459 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5a50cd8c-c2be-4932-b5ad-90181d63b7cf tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.302422 Oct 27 17:34:00.492118 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 246/458] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Oct 27 17:34:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:34:01.004022 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ad7816b9-e9f4-41f2-a315-ac5124d858df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:01.005581 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ad7816b9-e9f4-41f2-a315-ac5124d858df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:01.015181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ad7816b9-e9f4-41f2-a315-ac5124d858df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:01.015944 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ad7816b9-e9f4-41f2-a315-ac5124d858df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:01.016549 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ad7816b9-e9f4-41f2-a315-ac5124d858df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:01.017342 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ad7816b9-e9f4-41f2-a315-ac5124d858df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:01.017905 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ad7816b9-e9f4-41f2-a315-ac5124d858df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:01.018342 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ad7816b9-e9f4-41f2-a315-ac5124d858df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:01.281724 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ad7816b9-e9f4-41f2-a315-ac5124d858df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:01.289481 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ad7816b9-e9f4-41f2-a315-ac5124d858df tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1370 microversion: 2.1 time: 0.290936 Oct 27 17:34:01.290043 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 213/459] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:00 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1370 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:01.526691 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-f88f13d4-bb85-495b-a690-2356b0131c48 req-f6c2929f-2e80-42b8-baa4-0a9709e30e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41584d40-839e-4610-9c2b-7291f0d8d790", "tag": "9f15684a-2e4a-47e6-b9f4-740131fbedfb"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:01.540181 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-f88f13d4-bb85-495b-a690-2356b0131c48 req-f6c2929f-2e80-42b8-baa4-0a9709e30e01 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:01.540988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-f88f13d4-bb85-495b-a690-2356b0131c48 req-f6c2929f-2e80-42b8-baa4-0a9709e30e01 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:01.541674 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-f88f13d4-bb85-495b-a690-2356b0131c48 req-f6c2929f-2e80-42b8-baa4-0a9709e30e01 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:01.553282 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-f88f13d4-bb85-495b-a690-2356b0131c48 req-f6c2929f-2e80-42b8-baa4-0a9709e30e01 service nova] Creating event network-changed:9f15684a-2e4a-47e6-b9f4-740131fbedfb for instance 41584d40-839e-4610-9c2b-7291f0d8d790 on hv-cinder-86283 Oct 27 17:34:01.558592 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-f88f13d4-bb85-495b-a690-2356b0131c48 req-f6c2929f-2e80-42b8-baa4-0a9709e30e01 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037879 Oct 27 17:34:01.560378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 247/460] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:34:02.314079 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6b165c59-b5b2-4914-9c43-34e3c18e2d9d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:02.314737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6b165c59-b5b2-4914-9c43-34e3c18e2d9d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:02.322989 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b165c59-b5b2-4914-9c43-34e3c18e2d9d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:02.323283 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b165c59-b5b2-4914-9c43-34e3c18e2d9d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:02.323981 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b165c59-b5b2-4914-9c43-34e3c18e2d9d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:02.324797 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b165c59-b5b2-4914-9c43-34e3c18e2d9d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:02.325974 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b165c59-b5b2-4914-9c43-34e3c18e2d9d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:02.326442 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b165c59-b5b2-4914-9c43-34e3c18e2d9d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:02.510448 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-6b165c59-b5b2-4914-9c43-34e3c18e2d9d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:02.519042 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6b165c59-b5b2-4914-9c43-34e3c18e2d9d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1370 microversion: 2.1 time: 0.209364 Oct 27 17:34:02.519632 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 214/461] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:02 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1370 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:03.542674 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-68eedbe6-9078-45cf-bbf0-abab99da1264 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:03.543457 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-68eedbe6-9078-45cf-bbf0-abab99da1264 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:03.545726 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:34:03.553080 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-68eedbe6-9078-45cf-bbf0-abab99da1264 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:03.553856 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-68eedbe6-9078-45cf-bbf0-abab99da1264 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:03.554509 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-68eedbe6-9078-45cf-bbf0-abab99da1264 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:03.555424 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-68eedbe6-9078-45cf-bbf0-abab99da1264 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:03.556113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-68eedbe6-9078-45cf-bbf0-abab99da1264 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:03.556760 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-68eedbe6-9078-45cf-bbf0-abab99da1264 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:03.693401 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-68eedbe6-9078-45cf-bbf0-abab99da1264 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:03.702052 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-68eedbe6-9078-45cf-bbf0-abab99da1264 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1370 microversion: 2.1 time: 0.163687 Oct 27 17:34:03.714043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 248/462] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:03 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:04.726960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-fdf78eeb-b2c5-4df5-a6f2-e45f3e0d127a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:04.727930 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-fdf78eeb-b2c5-4df5-a6f2-e45f3e0d127a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:04.735375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fdf78eeb-b2c5-4df5-a6f2-e45f3e0d127a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:04.736168 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fdf78eeb-b2c5-4df5-a6f2-e45f3e0d127a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:04.736693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fdf78eeb-b2c5-4df5-a6f2-e45f3e0d127a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:04.737641 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fdf78eeb-b2c5-4df5-a6f2-e45f3e0d127a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:04.740312 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fdf78eeb-b2c5-4df5-a6f2-e45f3e0d127a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:04.740977 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fdf78eeb-b2c5-4df5-a6f2-e45f3e0d127a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:04.896990 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-fdf78eeb-b2c5-4df5-a6f2-e45f3e0d127a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:04.905617 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-fdf78eeb-b2c5-4df5-a6f2-e45f3e0d127a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1370 microversion: 2.1 time: 0.182744 Oct 27 17:34:04.906202 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 215/463] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:04 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:05.930306 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1f4786fd-3cab-4b6c-9b48-05875553f941 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:05.931042 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-1f4786fd-3cab-4b6c-9b48-05875553f941 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:05.939451 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1f4786fd-3cab-4b6c-9b48-05875553f941 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:05.939978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1f4786fd-3cab-4b6c-9b48-05875553f941 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:05.940424 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1f4786fd-3cab-4b6c-9b48-05875553f941 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:05.941621 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1f4786fd-3cab-4b6c-9b48-05875553f941 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:05.948094 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1f4786fd-3cab-4b6c-9b48-05875553f941 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:05.948583 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1f4786fd-3cab-4b6c-9b48-05875553f941 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:06.099206 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1f4786fd-3cab-4b6c-9b48-05875553f941 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:06.109036 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1f4786fd-3cab-4b6c-9b48-05875553f941 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1370 microversion: 2.1 time: 0.183148 Oct 27 17:34:06.109595 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 249/464] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:05 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:07.130342 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4122215d-7cf6-4ec6-a1e5-b68289363c01 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:07.130949 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4122215d-7cf6-4ec6-a1e5-b68289363c01 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:07.132788 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=8 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:34:07.139012 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4122215d-7cf6-4ec6-a1e5-b68289363c01 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:07.140240 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4122215d-7cf6-4ec6-a1e5-b68289363c01 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:07.140845 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4122215d-7cf6-4ec6-a1e5-b68289363c01 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:07.142140 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4122215d-7cf6-4ec6-a1e5-b68289363c01 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:07.142596 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4122215d-7cf6-4ec6-a1e5-b68289363c01 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:07.143021 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4122215d-7cf6-4ec6-a1e5-b68289363c01 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:07.285649 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4122215d-7cf6-4ec6-a1e5-b68289363c01 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:07.293132 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4122215d-7cf6-4ec6-a1e5-b68289363c01 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1370 microversion: 2.1 time: 0.166633 Oct 27 17:34:07.293692 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 216/465] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:07 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:08.316557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a6a75bf7-23e5-4f86-bcb5-34e50cd65bd1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:08.317169 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a6a75bf7-23e5-4f86-bcb5-34e50cd65bd1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:08.324228 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a6a75bf7-23e5-4f86-bcb5-34e50cd65bd1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:08.324714 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a6a75bf7-23e5-4f86-bcb5-34e50cd65bd1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:08.325158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a6a75bf7-23e5-4f86-bcb5-34e50cd65bd1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:08.326475 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a6a75bf7-23e5-4f86-bcb5-34e50cd65bd1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:08.326939 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a6a75bf7-23e5-4f86-bcb5-34e50cd65bd1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:08.327365 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a6a75bf7-23e5-4f86-bcb5-34e50cd65bd1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:08.457632 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a6a75bf7-23e5-4f86-bcb5-34e50cd65bd1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:08.465487 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a6a75bf7-23e5-4f86-bcb5-34e50cd65bd1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1370 microversion: 2.1 time: 0.152891 Oct 27 17:34:08.466057 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 250/466] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:08 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:08.625329 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-03cbcd18-0acc-4dc5-b48b-eb1245d5d5dc req-bd92055b-3c18-4057-be2e-a66884883b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41584d40-839e-4610-9c2b-7291f0d8d790", "name": "network-vif-plugged", "status": "completed", "tag": "9f15684a-2e4a-47e6-b9f4-740131fbedfb"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:08.635258 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-03cbcd18-0acc-4dc5-b48b-eb1245d5d5dc req-bd92055b-3c18-4057-be2e-a66884883b6b service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:08.635845 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-03cbcd18-0acc-4dc5-b48b-eb1245d5d5dc req-bd92055b-3c18-4057-be2e-a66884883b6b service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:08.636272 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-03cbcd18-0acc-4dc5-b48b-eb1245d5d5dc req-bd92055b-3c18-4057-be2e-a66884883b6b service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:08.647673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-03cbcd18-0acc-4dc5-b48b-eb1245d5d5dc req-bd92055b-3c18-4057-be2e-a66884883b6b service nova] Creating event network-vif-plugged:9f15684a-2e4a-47e6-b9f4-740131fbedfb for instance 41584d40-839e-4610-9c2b-7291f0d8d790 on hv-cinder-86283 Oct 27 17:34:08.652740 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-03cbcd18-0acc-4dc5-b48b-eb1245d5d5dc req-bd92055b-3c18-4057-be2e-a66884883b6b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031718 Oct 27 17:34:08.653312 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 217/467] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:34:09.488992 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6bbe27cf-ca6e-4050-99ca-d668d06b8e64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:09.489602 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-6bbe27cf-ca6e-4050-99ca-d668d06b8e64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:09.495994 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6bbe27cf-ca6e-4050-99ca-d668d06b8e64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:09.496477 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6bbe27cf-ca6e-4050-99ca-d668d06b8e64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:09.496907 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6bbe27cf-ca6e-4050-99ca-d668d06b8e64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:09.497592 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6bbe27cf-ca6e-4050-99ca-d668d06b8e64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:09.498588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6bbe27cf-ca6e-4050-99ca-d668d06b8e64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:09.499012 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6bbe27cf-ca6e-4050-99ca-d668d06b8e64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:09.629730 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-6bbe27cf-ca6e-4050-99ca-d668d06b8e64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:09.637660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6bbe27cf-ca6e-4050-99ca-d668d06b8e64 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1370 microversion: 2.1 time: 0.152654 Oct 27 17:34:09.638784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 251/468] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:09 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:10.662083 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9f72c542-7717-440e-9768-af98f1064fa4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:10.662671 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9f72c542-7717-440e-9768-af98f1064fa4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:10.668885 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f72c542-7717-440e-9768-af98f1064fa4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:10.669355 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f72c542-7717-440e-9768-af98f1064fa4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:10.670418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f72c542-7717-440e-9768-af98f1064fa4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:10.671093 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f72c542-7717-440e-9768-af98f1064fa4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:10.671537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f72c542-7717-440e-9768-af98f1064fa4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:10.671980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f72c542-7717-440e-9768-af98f1064fa4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:10.804253 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9f72c542-7717-440e-9768-af98f1064fa4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:10.812160 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9f72c542-7717-440e-9768-af98f1064fa4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1370 microversion: 2.1 time: 0.154777 Oct 27 17:34:10.812746 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 218/469] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:10 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:11.834728 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ee91848a-18ee-4c30-a00f-9f82a4984310 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:11.835298 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-ee91848a-18ee-4c30-a00f-9f82a4984310 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:11.837116 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=14 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:34:11.842860 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ee91848a-18ee-4c30-a00f-9f82a4984310 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:11.843335 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ee91848a-18ee-4c30-a00f-9f82a4984310 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:11.843819 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ee91848a-18ee-4c30-a00f-9f82a4984310 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:11.844501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ee91848a-18ee-4c30-a00f-9f82a4984310 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:11.844946 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ee91848a-18ee-4c30-a00f-9f82a4984310 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:11.845360 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ee91848a-18ee-4c30-a00f-9f82a4984310 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:11.984880 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ee91848a-18ee-4c30-a00f-9f82a4984310 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:11.993260 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-ee91848a-18ee-4c30-a00f-9f82a4984310 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1564 microversion: 2.1 time: 0.162576 Oct 27 17:34:11.993834 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 252/470] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:11 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:12.017269 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-44fce7e9-3818-4f31-b687-ba5d58dcb41e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:12.017853 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-44fce7e9-3818-4f31-b687-ba5d58dcb41e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:12.024193 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44fce7e9-3818-4f31-b687-ba5d58dcb41e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:12.024679 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44fce7e9-3818-4f31-b687-ba5d58dcb41e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:12.025117 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44fce7e9-3818-4f31-b687-ba5d58dcb41e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:12.025807 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44fce7e9-3818-4f31-b687-ba5d58dcb41e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:12.026259 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44fce7e9-3818-4f31-b687-ba5d58dcb41e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:12.026686 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44fce7e9-3818-4f31-b687-ba5d58dcb41e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:12.105879 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-44fce7e9-3818-4f31-b687-ba5d58dcb41e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092573 Oct 27 17:34:12.106477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 219/471] 10.222.0.36 () {58 vars in 1275 bytes} [Thu Oct 27 17:34:12 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:34:13.030619 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-bed22ffc-f853-43eb-a2b0-ce79f7c315ff req-e22f438f-1ff4-4945-90ed-902bee7cb206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41584d40-839e-4610-9c2b-7291f0d8d790", "tag": "9f15684a-2e4a-47e6-b9f4-740131fbedfb"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:13.040420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-bed22ffc-f853-43eb-a2b0-ce79f7c315ff req-e22f438f-1ff4-4945-90ed-902bee7cb206 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:13.041206 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-bed22ffc-f853-43eb-a2b0-ce79f7c315ff req-e22f438f-1ff4-4945-90ed-902bee7cb206 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:13.041953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-bed22ffc-f853-43eb-a2b0-ce79f7c315ff req-e22f438f-1ff4-4945-90ed-902bee7cb206 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:13.056219 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-bed22ffc-f853-43eb-a2b0-ce79f7c315ff req-e22f438f-1ff4-4945-90ed-902bee7cb206 service nova] Creating event network-changed:9f15684a-2e4a-47e6-b9f4-740131fbedfb for instance 41584d40-839e-4610-9c2b-7291f0d8d790 on hv-cinder-86283 Oct 27 17:34:13.061650 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-bed22ffc-f853-43eb-a2b0-ce79f7c315ff req-e22f438f-1ff4-4945-90ed-902bee7cb206 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034654 Oct 27 17:34:13.062600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 253/472] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:34:20.159607 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b58e1f6d-bf52-46e1-a35f-8e8a3b061465 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:20.160140 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b58e1f6d-bf52-46e1-a35f-8e8a3b061465 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:20.162055 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:34:20.167773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b58e1f6d-bf52-46e1-a35f-8e8a3b061465 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:20.168253 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b58e1f6d-bf52-46e1-a35f-8e8a3b061465 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:20.168679 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b58e1f6d-bf52-46e1-a35f-8e8a3b061465 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:20.169351 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b58e1f6d-bf52-46e1-a35f-8e8a3b061465 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:20.169793 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b58e1f6d-bf52-46e1-a35f-8e8a3b061465 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:20.170206 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b58e1f6d-bf52-46e1-a35f-8e8a3b061465 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:20.194451 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b58e1f6d-bf52-46e1-a35f-8e8a3b061465 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/ips" status: 200 len: 150 microversion: 2.20 time: 0.039392 Oct 27 17:34:20.195001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 220/473] 10.222.0.36 () {60 vars in 1289 bytes} [Thu Oct 27 17:34:20 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:34:20.728422 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-3115f817-795f-4e92-ae5c-2299dd97eb7c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:20.728936 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-3115f817-795f-4e92-ae5c-2299dd97eb7c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:20.731162 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:34:20.736734 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3115f817-795f-4e92-ae5c-2299dd97eb7c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:20.737212 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3115f817-795f-4e92-ae5c-2299dd97eb7c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:20.737644 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3115f817-795f-4e92-ae5c-2299dd97eb7c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:20.738333 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3115f817-795f-4e92-ae5c-2299dd97eb7c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:20.738783 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3115f817-795f-4e92-ae5c-2299dd97eb7c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:20.739202 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3115f817-795f-4e92-ae5c-2299dd97eb7c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:20.762394 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-3115f817-795f-4e92-ae5c-2299dd97eb7c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702/ips" status: 200 len: 149 microversion: 2.1 time: 0.039044 Oct 27 17:34:20.762957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 254/474] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Oct 27 17:34:20 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:34:22.346222 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6854f3c3-3c48-44f9-8200-1141b242f54d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:22.346730 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6854f3c3-3c48-44f9-8200-1141b242f54d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:22.353366 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6854f3c3-3c48-44f9-8200-1141b242f54d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:22.353837 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6854f3c3-3c48-44f9-8200-1141b242f54d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:22.354523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6854f3c3-3c48-44f9-8200-1141b242f54d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:22.355197 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6854f3c3-3c48-44f9-8200-1141b242f54d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:22.355638 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6854f3c3-3c48-44f9-8200-1141b242f54d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:22.356077 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6854f3c3-3c48-44f9-8200-1141b242f54d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:22.378946 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6854f3c3-3c48-44f9-8200-1141b242f54d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/ips" status: 200 len: 145 microversion: 2.1 time: 0.037215 Oct 27 17:34:22.379501 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 221/475] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Oct 27 17:34:22 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:34:23.088539 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-02902417-e6ff-4bb1-b55e-60269e89082f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:23.089315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-02902417-e6ff-4bb1-b55e-60269e89082f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:23.096053 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-02902417-e6ff-4bb1-b55e-60269e89082f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:23.096555 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-02902417-e6ff-4bb1-b55e-60269e89082f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:23.097040 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-02902417-e6ff-4bb1-b55e-60269e89082f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:23.097756 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-02902417-e6ff-4bb1-b55e-60269e89082f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:23.098203 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-02902417-e6ff-4bb1-b55e-60269e89082f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:23.098626 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-02902417-e6ff-4bb1-b55e-60269e89082f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:23.122536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.objects.instance [None req-02902417-e6ff-4bb1-b55e-60269e89082f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lazy-loading 'flavor' on Instance uuid 2b27a822-4c22-45f0-872b-67e5f360f45e {{(pid=119047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:34:23.312819 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-02902417-e6ff-4bb1-b55e-60269e89082f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "POST /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/action" status: 202 len: 0 microversion: 2.20 time: 0.228020 Oct 27 17:34:23.313509 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 255/476] 10.222.0.36 () {62 vars in 1319 bytes} [Thu Oct 27 17:34:23 2022] POST /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:34:23.321877 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e6abbb79-006d-4a4b-b684-73b0bb8e514d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:23.322495 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e6abbb79-006d-4a4b-b684-73b0bb8e514d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:23.328815 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e6abbb79-006d-4a4b-b684-73b0bb8e514d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:23.329300 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e6abbb79-006d-4a4b-b684-73b0bb8e514d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:23.329729 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e6abbb79-006d-4a4b-b684-73b0bb8e514d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:23.330597 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e6abbb79-006d-4a4b-b684-73b0bb8e514d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:23.331206 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e6abbb79-006d-4a4b-b684-73b0bb8e514d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:23.331642 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e6abbb79-006d-4a4b-b684-73b0bb8e514d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:23.462707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e6abbb79-006d-4a4b-b684-73b0bb8e514d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:23.470746 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e6abbb79-006d-4a4b-b684-73b0bb8e514d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:23.472213 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e6abbb79-006d-4a4b-b684-73b0bb8e514d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:23.473359 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e6abbb79-006d-4a4b-b684-73b0bb8e514d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.155349 Oct 27 17:34:23.473907 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 222/477] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:23 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:24.231793 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6686c4fd-ba84-428c-938a-dc212225e64a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96b328e6-8e5f-48de-9de7-381ccfee4804"}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:24.234795 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-6686c4fd-ba84-428c-938a-dc212225e64a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:24.243517 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6686c4fd-ba84-428c-938a-dc212225e64a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:24.244031 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6686c4fd-ba84-428c-938a-dc212225e64a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:24.244461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6686c4fd-ba84-428c-938a-dc212225e64a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:24.245132 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6686c4fd-ba84-428c-938a-dc212225e64a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:24.245576 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6686c4fd-ba84-428c-938a-dc212225e64a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:24.246024 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6686c4fd-ba84-428c-938a-dc212225e64a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:24.498701 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4e44dc1a-da3a-44ee-8645-9a779542eb07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:24.499307 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4e44dc1a-da3a-44ee-8645-9a779542eb07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:24.505807 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4e44dc1a-da3a-44ee-8645-9a779542eb07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:24.506285 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4e44dc1a-da3a-44ee-8645-9a779542eb07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:24.506713 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4e44dc1a-da3a-44ee-8645-9a779542eb07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:24.507393 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4e44dc1a-da3a-44ee-8645-9a779542eb07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:24.507871 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4e44dc1a-da3a-44ee-8645-9a779542eb07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:24.508288 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4e44dc1a-da3a-44ee-8645-9a779542eb07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:24.666857 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4e44dc1a-da3a-44ee-8645-9a779542eb07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:24.675508 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4e44dc1a-da3a-44ee-8645-9a779542eb07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:24.677116 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4e44dc1a-da3a-44ee-8645-9a779542eb07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:24.678531 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4e44dc1a-da3a-44ee-8645-9a779542eb07 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.183840 Oct 27 17:34:24.679251 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 223/478] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:24 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:34:24.737512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6686c4fd-ba84-428c-938a-dc212225e64a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "POST /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.510369 Oct 27 17:34:24.738113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 256/479] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Oct 27 17:34:24 2022] POST /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702/os-volume_attachments => generated 194 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:34:25.705081 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8aa6306b-868e-40bc-b7e4-d52857e3ac7b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:25.705616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8aa6306b-868e-40bc-b7e4-d52857e3ac7b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:25.713429 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8aa6306b-868e-40bc-b7e4-d52857e3ac7b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:25.714098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8aa6306b-868e-40bc-b7e4-d52857e3ac7b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:25.714695 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8aa6306b-868e-40bc-b7e4-d52857e3ac7b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:25.715922 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8aa6306b-868e-40bc-b7e4-d52857e3ac7b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:25.716535 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8aa6306b-868e-40bc-b7e4-d52857e3ac7b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:25.717192 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8aa6306b-868e-40bc-b7e4-d52857e3ac7b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:25.848825 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8aa6306b-868e-40bc-b7e4-d52857e3ac7b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:25.857515 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8aa6306b-868e-40bc-b7e4-d52857e3ac7b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:25.858947 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8aa6306b-868e-40bc-b7e4-d52857e3ac7b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:25.860122 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8aa6306b-868e-40bc-b7e4-d52857e3ac7b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.159056 Oct 27 17:34:25.860666 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 224/480] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:25 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:26.885860 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-9660d4da-a39b-4db6-b39a-cb014f076f7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:26.886672 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-9660d4da-a39b-4db6-b39a-cb014f076f7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:26.893068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9660d4da-a39b-4db6-b39a-cb014f076f7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:26.893544 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9660d4da-a39b-4db6-b39a-cb014f076f7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:26.893970 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9660d4da-a39b-4db6-b39a-cb014f076f7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:26.894993 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9660d4da-a39b-4db6-b39a-cb014f076f7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:26.895443 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9660d4da-a39b-4db6-b39a-cb014f076f7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:26.895895 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9660d4da-a39b-4db6-b39a-cb014f076f7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:27.032331 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9660d4da-a39b-4db6-b39a-cb014f076f7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:27.039181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b25dfece-8119-4426-bea1-088d899fe3c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a38355ee-0da9-42ca-8b4f-7de71380925b"}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:27.041675 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b25dfece-8119-4426-bea1-088d899fe3c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:27.042274 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9660d4da-a39b-4db6-b39a-cb014f076f7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:27.043765 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9660d4da-a39b-4db6-b39a-cb014f076f7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:27.044998 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-9660d4da-a39b-4db6-b39a-cb014f076f7a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.164246 Oct 27 17:34:27.045552 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 257/481] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:26 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:27.049302 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b25dfece-8119-4426-bea1-088d899fe3c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:27.049861 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b25dfece-8119-4426-bea1-088d899fe3c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:27.050362 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b25dfece-8119-4426-bea1-088d899fe3c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:27.051066 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b25dfece-8119-4426-bea1-088d899fe3c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:27.051520 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b25dfece-8119-4426-bea1-088d899fe3c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:27.051968 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b25dfece-8119-4426-bea1-088d899fe3c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:27.313378 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b25dfece-8119-4426-bea1-088d899fe3c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "POST /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277867 Oct 27 17:34:27.314235 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 225/482] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Oct 27 17:34:27 2022] POST /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:34:28.070313 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-fcdeb09f-3d48-4273-b550-f7bc5d9d68d1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:28.070917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-fcdeb09f-3d48-4273-b550-f7bc5d9d68d1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:28.077412 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcdeb09f-3d48-4273-b550-f7bc5d9d68d1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:28.077886 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcdeb09f-3d48-4273-b550-f7bc5d9d68d1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:28.078314 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcdeb09f-3d48-4273-b550-f7bc5d9d68d1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:28.078995 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcdeb09f-3d48-4273-b550-f7bc5d9d68d1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:28.079442 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcdeb09f-3d48-4273-b550-f7bc5d9d68d1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:28.079887 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcdeb09f-3d48-4273-b550-f7bc5d9d68d1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:28.203734 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fcdeb09f-3d48-4273-b550-f7bc5d9d68d1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:28.211649 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fcdeb09f-3d48-4273-b550-f7bc5d9d68d1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:28.213093 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fcdeb09f-3d48-4273-b550-f7bc5d9d68d1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:28.214257 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-fcdeb09f-3d48-4273-b550-f7bc5d9d68d1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.147794 Oct 27 17:34:28.214809 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 258/483] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:28 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:28.967921 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1584029286", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1230701945", "security_groups": [{"name": "tempest-secgroup-smoke-1482951758"}], "networks": [{"uuid": "6b46168e-b39c-4a8b-b4c9-8fbae902deb6"}], "block_device_mapping_v2": [{"uuid": "0810dbc1-b8ff-4507-9bc3-af9a99ea5502", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:29.080666 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.network.neutron [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] validate_networks() for [('6b46168e-b39c-4a8b-b4c9-8fbae902deb6', None, None, None, None, None)] {{(pid=119046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:34:29.239424 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-521be311-09da-47ea-bb13-2496adc3caf7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:29.240082 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-521be311-09da-47ea-bb13-2496adc3caf7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:29.246435 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-521be311-09da-47ea-bb13-2496adc3caf7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:29.246922 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-521be311-09da-47ea-bb13-2496adc3caf7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:29.247357 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-521be311-09da-47ea-bb13-2496adc3caf7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:29.248076 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-521be311-09da-47ea-bb13-2496adc3caf7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:29.248535 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-521be311-09da-47ea-bb13-2496adc3caf7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:29.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-521be311-09da-47ea-bb13-2496adc3caf7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:29.253640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:34:29.385944 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-521be311-09da-47ea-bb13-2496adc3caf7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:29.395172 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-521be311-09da-47ea-bb13-2496adc3caf7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:29.396629 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-521be311-09da-47ea-bb13-2496adc3caf7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:29.397778 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-521be311-09da-47ea-bb13-2496adc3caf7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.162344 Oct 27 17:34:29.398719 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 259/484] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:29 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:34:29.446418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Flavor limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:34:29.446840 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Image limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:34:29.447307 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Flavor pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:34:29.447727 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Image pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:34:29.448246 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:34:29.457485 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:29.457983 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:29.458404 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:29.459120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:29.459564 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:29.460008 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:29.467125 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:34:29.478960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Getting quotas for project d8c77f9e29f141c7b5a02d8b7eb62da3. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:34:29.483746 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Getting quotas for user 76c92a21193a43e4838e625f2d2e4dd5 and project d8c77f9e29f141c7b5a02d8b7eb62da3. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:34:29.538830 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Going to run 1 instances... {{(pid=119046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:34:29.541073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0810dbc1-b8ff-4507-9bc3-af9a99ea5502',volume_size=None,volume_type=None)] {{(pid=119046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:34:29.667342 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7207453f-f6a2-4793-8fb2-13c3c4634e08 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.703613 Oct 27 17:34:29.668018 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 226/485] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:34:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:34:29.679596 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-499eefc6-2c16-484f-ad71-bf3beba3413f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:29.680229 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-499eefc6-2c16-484f-ad71-bf3beba3413f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:29.731784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-499eefc6-2c16-484f-ad71-bf3beba3413f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:29.739088 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-499eefc6-2c16-484f-ad71-bf3beba3413f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1089 microversion: 2.1 time: 0.063386 Oct 27 17:34:29.739646 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 260/486] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:29 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1089 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:30.422905 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-dfe6db19-24e2-4aa3-97f2-8fb0a862e219 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:30.423513 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-dfe6db19-24e2-4aa3-97f2-8fb0a862e219 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:30.430365 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dfe6db19-24e2-4aa3-97f2-8fb0a862e219 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:30.430846 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dfe6db19-24e2-4aa3-97f2-8fb0a862e219 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:30.431311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dfe6db19-24e2-4aa3-97f2-8fb0a862e219 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:30.432034 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dfe6db19-24e2-4aa3-97f2-8fb0a862e219 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:30.432488 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dfe6db19-24e2-4aa3-97f2-8fb0a862e219 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:30.432908 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dfe6db19-24e2-4aa3-97f2-8fb0a862e219 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:30.575962 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-dfe6db19-24e2-4aa3-97f2-8fb0a862e219 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:30.584705 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-dfe6db19-24e2-4aa3-97f2-8fb0a862e219 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:30.586140 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-dfe6db19-24e2-4aa3-97f2-8fb0a862e219 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:30.587286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-dfe6db19-24e2-4aa3-97f2-8fb0a862e219 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.168834 Oct 27 17:34:30.587866 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 227/487] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:30 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:30.762233 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1911c69a-f993-4f92-babb-a487e41cae87 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:30.762837 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-1911c69a-f993-4f92-babb-a487e41cae87 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:30.770404 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1911c69a-f993-4f92-babb-a487e41cae87 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:30.770880 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1911c69a-f993-4f92-babb-a487e41cae87 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:30.771305 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1911c69a-f993-4f92-babb-a487e41cae87 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:30.772014 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1911c69a-f993-4f92-babb-a487e41cae87 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:30.772463 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1911c69a-f993-4f92-babb-a487e41cae87 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:30.772879 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1911c69a-f993-4f92-babb-a487e41cae87 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:30.831453 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1911c69a-f993-4f92-babb-a487e41cae87 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:30.838957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1911c69a-f993-4f92-babb-a487e41cae87 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1187 microversion: 2.1 time: 0.080567 Oct 27 17:34:30.839511 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 261/488] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:30 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1187 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:31.614220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e9f51d63-cd42-4cfe-985a-c5054c23a2be tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:31.614795 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e9f51d63-cd42-4cfe-985a-c5054c23a2be tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:31.621154 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e9f51d63-cd42-4cfe-985a-c5054c23a2be tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:31.621638 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e9f51d63-cd42-4cfe-985a-c5054c23a2be tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:31.622065 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e9f51d63-cd42-4cfe-985a-c5054c23a2be tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:31.622748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e9f51d63-cd42-4cfe-985a-c5054c23a2be tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:31.623199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e9f51d63-cd42-4cfe-985a-c5054c23a2be tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:31.623616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e9f51d63-cd42-4cfe-985a-c5054c23a2be tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:31.851027 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e9f51d63-cd42-4cfe-985a-c5054c23a2be tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:31.862333 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f51a3f78-4e3d-4873-8279-3c1820ee52db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:31.863651 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f51a3f78-4e3d-4873-8279-3c1820ee52db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:31.867128 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e9f51d63-cd42-4cfe-985a-c5054c23a2be tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:31.869476 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e9f51d63-cd42-4cfe-985a-c5054c23a2be tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:31.870862 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e9f51d63-cd42-4cfe-985a-c5054c23a2be tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.260354 Oct 27 17:34:31.873246 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f51a3f78-4e3d-4873-8279-3c1820ee52db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:31.873847 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f51a3f78-4e3d-4873-8279-3c1820ee52db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:31.874384 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f51a3f78-4e3d-4873-8279-3c1820ee52db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:31.875193 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f51a3f78-4e3d-4873-8279-3c1820ee52db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:31.875776 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f51a3f78-4e3d-4873-8279-3c1820ee52db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:31.876316 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f51a3f78-4e3d-4873-8279-3c1820ee52db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:31.892306 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 228/489] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:31 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:32.012866 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f51a3f78-4e3d-4873-8279-3c1820ee52db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:32.021908 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f51a3f78-4e3d-4873-8279-3c1820ee52db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1273 microversion: 2.1 time: 0.163723 Oct 27 17:34:32.022481 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 262/490] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:31 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:32.687018 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-11f89bc2-bd66-4985-b138-0efb2f1d5fca req-e8e08ce3-0240-4032-9e40-52878e9eb99c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26a883d9-7208-49ab-9775-557bba9f7efd", "tag": "469bd0cf-71f5-4704-9199-a07d128929ab"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:32.697253 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-11f89bc2-bd66-4985-b138-0efb2f1d5fca req-e8e08ce3-0240-4032-9e40-52878e9eb99c service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:32.697727 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-11f89bc2-bd66-4985-b138-0efb2f1d5fca req-e8e08ce3-0240-4032-9e40-52878e9eb99c service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:32.698153 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-11f89bc2-bd66-4985-b138-0efb2f1d5fca req-e8e08ce3-0240-4032-9e40-52878e9eb99c service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:32.709462 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-11f89bc2-bd66-4985-b138-0efb2f1d5fca req-e8e08ce3-0240-4032-9e40-52878e9eb99c service nova] Creating event network-changed:469bd0cf-71f5-4704-9199-a07d128929ab for instance 26a883d9-7208-49ab-9775-557bba9f7efd on hv-cinder-86283 Oct 27 17:34:32.714363 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-11f89bc2-bd66-4985-b138-0efb2f1d5fca req-e8e08ce3-0240-4032-9e40-52878e9eb99c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030980 Oct 27 17:34:32.714944 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 229/491] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:34:32.896333 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-976c5e8f-617f-4703-9614-3822b53309c2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:32.896865 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-976c5e8f-617f-4703-9614-3822b53309c2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:32.903295 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-976c5e8f-617f-4703-9614-3822b53309c2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:32.903803 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-976c5e8f-617f-4703-9614-3822b53309c2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:32.904234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-976c5e8f-617f-4703-9614-3822b53309c2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:32.904912 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-976c5e8f-617f-4703-9614-3822b53309c2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:32.905358 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-976c5e8f-617f-4703-9614-3822b53309c2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:32.906279 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-976c5e8f-617f-4703-9614-3822b53309c2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:33.042763 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-976c5e8f-617f-4703-9614-3822b53309c2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:33.046009 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-68251f01-4abe-4381-b9b3-ffababc55e26 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:33.047305 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-68251f01-4abe-4381-b9b3-ffababc55e26 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:33.051922 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-976c5e8f-617f-4703-9614-3822b53309c2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:33.053349 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-976c5e8f-617f-4703-9614-3822b53309c2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:33.053827 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-68251f01-4abe-4381-b9b3-ffababc55e26 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:33.054322 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-68251f01-4abe-4381-b9b3-ffababc55e26 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:33.054495 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-976c5e8f-617f-4703-9614-3822b53309c2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.162176 Oct 27 17:34:33.054757 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-68251f01-4abe-4381-b9b3-ffababc55e26 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:33.055047 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 263/492] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:32 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:33.055460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-68251f01-4abe-4381-b9b3-ffababc55e26 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:33.055951 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-68251f01-4abe-4381-b9b3-ffababc55e26 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:33.056702 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-68251f01-4abe-4381-b9b3-ffababc55e26 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:33.186072 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-68251f01-4abe-4381-b9b3-ffababc55e26 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:33.193612 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-68251f01-4abe-4381-b9b3-ffababc55e26 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1273 microversion: 2.1 time: 0.151808 Oct 27 17:34:33.194176 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 230/493] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:33 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:34.080233 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-39c61817-cc57-4ed1-bc8c-24faccb3bc0b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:34.080847 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-39c61817-cc57-4ed1-bc8c-24faccb3bc0b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:34.087438 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-39c61817-cc57-4ed1-bc8c-24faccb3bc0b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:34.087910 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-39c61817-cc57-4ed1-bc8c-24faccb3bc0b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:34.088347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-39c61817-cc57-4ed1-bc8c-24faccb3bc0b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:34.089039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-39c61817-cc57-4ed1-bc8c-24faccb3bc0b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:34.089491 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-39c61817-cc57-4ed1-bc8c-24faccb3bc0b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:34.089918 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-39c61817-cc57-4ed1-bc8c-24faccb3bc0b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:34.216123 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b4e37258-eb91-4d63-97f9-09c26654f48f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:34.216806 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b4e37258-eb91-4d63-97f9-09c26654f48f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:34.219562 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-39c61817-cc57-4ed1-bc8c-24faccb3bc0b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:34.223504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4e37258-eb91-4d63-97f9-09c26654f48f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:34.224017 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4e37258-eb91-4d63-97f9-09c26654f48f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:34.224448 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4e37258-eb91-4d63-97f9-09c26654f48f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:34.225137 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4e37258-eb91-4d63-97f9-09c26654f48f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:34.225582 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4e37258-eb91-4d63-97f9-09c26654f48f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:34.225996 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4e37258-eb91-4d63-97f9-09c26654f48f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:34.228112 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-39c61817-cc57-4ed1-bc8c-24faccb3bc0b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:34.230119 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-39c61817-cc57-4ed1-bc8c-24faccb3bc0b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:34.231448 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-39c61817-cc57-4ed1-bc8c-24faccb3bc0b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.155284 Oct 27 17:34:34.232041 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 264/494] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:34 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:34.368683 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b4e37258-eb91-4d63-97f9-09c26654f48f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:34.376967 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b4e37258-eb91-4d63-97f9-09c26654f48f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1273 microversion: 2.1 time: 0.164737 Oct 27 17:34:34.377550 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 231/495] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:34 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:34.411581 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-91ba65de-6f53-4381-94a7-b034a226264b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Action: 'create', calling method: .version_select at 0x7f0788627700>, body: {"keypair": {"name": "tempest-keypair-481389143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfZuksL3f+FfrVGhKt6rbB3Rzx97XTOh30JDVH8YIHhZQu2qG/CtdIxO33tInBtfvlKQty/lZYkD6v0UDLgQ3qu0tH8Zjdu6ZrwvsRt8D9Lkms9p7F26MOTNGImmd/Nxg=="}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:34.427462 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-91ba65de-6f53-4381-94a7-b034a226264b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Getting quotas for project a35c2b53ccb445d4b0dd2915376f69cf. Resources: {'key_pairs'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:34:34.431309 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-91ba65de-6f53-4381-94a7-b034a226264b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Getting quotas for user 3c36ea3a53cc48fa996891e3c6ddfda8 and project a35c2b53ccb445d4b0dd2915376f69cf. Resources: {'key_pairs'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:34:34.452798 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-91ba65de-6f53-4381-94a7-b034a226264b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045025 Oct 27 17:34:34.453368 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 265/496] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Oct 27 17:34:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:34:35.258286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e8725840-a708-40ba-83f5-75383fa299b9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:35.258892 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e8725840-a708-40ba-83f5-75383fa299b9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:35.265214 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e8725840-a708-40ba-83f5-75383fa299b9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:35.265694 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e8725840-a708-40ba-83f5-75383fa299b9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:35.266177 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e8725840-a708-40ba-83f5-75383fa299b9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:35.266816 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e8725840-a708-40ba-83f5-75383fa299b9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:35.267337 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e8725840-a708-40ba-83f5-75383fa299b9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:35.267772 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e8725840-a708-40ba-83f5-75383fa299b9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:35.400328 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-73ffbb22-2f72-4d57-beb5-14c5f47c1b4f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:35.400935 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-73ffbb22-2f72-4d57-beb5-14c5f47c1b4f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:35.407598 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-73ffbb22-2f72-4d57-beb5-14c5f47c1b4f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:35.408330 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-73ffbb22-2f72-4d57-beb5-14c5f47c1b4f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:35.408767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-73ffbb22-2f72-4d57-beb5-14c5f47c1b4f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:35.409462 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-73ffbb22-2f72-4d57-beb5-14c5f47c1b4f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:35.409980 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-73ffbb22-2f72-4d57-beb5-14c5f47c1b4f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:35.410460 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-73ffbb22-2f72-4d57-beb5-14c5f47c1b4f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:35.471530 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e8725840-a708-40ba-83f5-75383fa299b9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:35.480969 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e8725840-a708-40ba-83f5-75383fa299b9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:35.482437 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e8725840-a708-40ba-83f5-75383fa299b9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:35.483859 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e8725840-a708-40ba-83f5-75383fa299b9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.229339 Oct 27 17:34:35.484926 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 232/497] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:35 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:35.560276 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-73ffbb22-2f72-4d57-beb5-14c5f47c1b4f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:35.568072 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-73ffbb22-2f72-4d57-beb5-14c5f47c1b4f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1273 microversion: 2.1 time: 0.172376 Oct 27 17:34:35.568645 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 266/498] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:35 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1273 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:36.229507 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-711621253", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "40b6c3a9-49a5-4aa8-abaa-a41beea7c111"}], "security_groups": [{"name": "tempest-securitygroup--1811244641"}], "key_name": "tempest-keypair-481389143", "user_data": "}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:36.333323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.network.neutron [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] validate_networks() for [('40b6c3a9-49a5-4aa8-abaa-a41beea7c111', None, None, None, None, None)] {{(pid=119046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:34:36.509405 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-78859c7b-80ea-461b-a607-5266642e749e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:36.510012 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-78859c7b-80ea-461b-a607-5266642e749e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:36.516636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-78859c7b-80ea-461b-a607-5266642e749e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:36.517116 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-78859c7b-80ea-461b-a607-5266642e749e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:36.517548 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-78859c7b-80ea-461b-a607-5266642e749e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:36.518232 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-78859c7b-80ea-461b-a607-5266642e749e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:36.518683 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-78859c7b-80ea-461b-a607-5266642e749e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:36.519106 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-78859c7b-80ea-461b-a607-5266642e749e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:36.651673 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-78859c7b-80ea-461b-a607-5266642e749e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:36.660342 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-78859c7b-80ea-461b-a607-5266642e749e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:36.661840 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-78859c7b-80ea-461b-a607-5266642e749e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:36.663041 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-78859c7b-80ea-461b-a607-5266642e749e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.157573 Oct 27 17:34:36.663605 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 267/499] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:36 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:34:36.668121 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-233bc74c-ae0d-4d30-ac8a-5a55332cd9b2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:36.668913 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-233bc74c-ae0d-4d30-ac8a-5a55332cd9b2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:36.674597 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-233bc74c-ae0d-4d30-ac8a-5a55332cd9b2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:36.675075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-233bc74c-ae0d-4d30-ac8a-5a55332cd9b2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:36.675666 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-233bc74c-ae0d-4d30-ac8a-5a55332cd9b2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:36.676564 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-233bc74c-ae0d-4d30-ac8a-5a55332cd9b2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:36.677020 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-233bc74c-ae0d-4d30-ac8a-5a55332cd9b2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:36.677444 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-233bc74c-ae0d-4d30-ac8a-5a55332cd9b2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:36.712844 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Flavor limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:34:36.713286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Image limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:34:36.713761 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Flavor pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:34:36.714165 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Image pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:34:36.714569 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:34:36.723676 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:36.724186 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:36.724617 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:36.725336 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:36.725784 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:36.726212 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:36.743008 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Getting quotas for project a35c2b53ccb445d4b0dd2915376f69cf. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:34:36.747167 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Getting quotas for user 3c36ea3a53cc48fa996891e3c6ddfda8 and project a35c2b53ccb445d4b0dd2915376f69cf. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:34:36.758983 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Going to run 1 instances... {{(pid=119046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:34:36.761333 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:34:36.809648 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-233bc74c-ae0d-4d30-ac8a-5a55332cd9b2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:36.816626 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4ce2d979-6afa-4896-903d-a05eafdd4636 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.591594 Oct 27 17:34:36.817503 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 233/500] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:34:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:34:36.818145 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-233bc74c-ae0d-4d30-ac8a-5a55332cd9b2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1273 microversion: 2.1 time: 0.153390 Oct 27 17:34:36.818787 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 268/501] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:36 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:36.836213 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-c47c687d-3f8f-4440-a4b3-aba1d5da787a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:36.836863 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c47c687d-3f8f-4440-a4b3-aba1d5da787a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:36.891005 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-c47c687d-3f8f-4440-a4b3-aba1d5da787a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:36.898310 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-c47c687d-3f8f-4440-a4b3-aba1d5da787a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1240 microversion: 2.1 time: 0.073208 Oct 27 17:34:36.904511 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 234/502] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:36 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:37.688216 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a73e9eaf-60d7-412f-85ab-64e55a50e642 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:37.688820 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a73e9eaf-60d7-412f-85ab-64e55a50e642 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:37.695224 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a73e9eaf-60d7-412f-85ab-64e55a50e642 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:37.695698 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a73e9eaf-60d7-412f-85ab-64e55a50e642 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:37.696159 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a73e9eaf-60d7-412f-85ab-64e55a50e642 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:37.696853 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a73e9eaf-60d7-412f-85ab-64e55a50e642 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:37.697283 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a73e9eaf-60d7-412f-85ab-64e55a50e642 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:37.697695 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a73e9eaf-60d7-412f-85ab-64e55a50e642 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:37.828425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a73e9eaf-60d7-412f-85ab-64e55a50e642 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:37.836761 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a73e9eaf-60d7-412f-85ab-64e55a50e642 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:37.838198 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a73e9eaf-60d7-412f-85ab-64e55a50e642 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:37.839345 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a73e9eaf-60d7-412f-85ab-64e55a50e642 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.155553 Oct 27 17:34:37.839928 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 269/503] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:37 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:37.841258 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-1e5ed35e-3b0b-432d-8f67-e3a64bc0baaa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:37.841872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-1e5ed35e-3b0b-432d-8f67-e3a64bc0baaa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:37.849020 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1e5ed35e-3b0b-432d-8f67-e3a64bc0baaa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:37.849509 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1e5ed35e-3b0b-432d-8f67-e3a64bc0baaa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:37.849937 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1e5ed35e-3b0b-432d-8f67-e3a64bc0baaa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:37.850623 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1e5ed35e-3b0b-432d-8f67-e3a64bc0baaa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:37.851081 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1e5ed35e-3b0b-432d-8f67-e3a64bc0baaa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:37.851506 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1e5ed35e-3b0b-432d-8f67-e3a64bc0baaa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:37.920234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b73820f8-f69e-4f7e-989a-11dcaebf286d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:37.920846 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b73820f8-f69e-4f7e-989a-11dcaebf286d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:37.928710 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b73820f8-f69e-4f7e-989a-11dcaebf286d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:37.929199 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b73820f8-f69e-4f7e-989a-11dcaebf286d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:37.929629 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b73820f8-f69e-4f7e-989a-11dcaebf286d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:37.930318 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b73820f8-f69e-4f7e-989a-11dcaebf286d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:37.930762 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b73820f8-f69e-4f7e-989a-11dcaebf286d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:37.931176 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b73820f8-f69e-4f7e-989a-11dcaebf286d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:37.988712 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1e5ed35e-3b0b-432d-8f67-e3a64bc0baaa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:37.993433 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-b73820f8-f69e-4f7e-989a-11dcaebf286d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:37.996426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-1e5ed35e-3b0b-432d-8f67-e3a64bc0baaa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1273 microversion: 2.1 time: 0.159018 Oct 27 17:34:37.996989 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 235/504] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:37 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:38.002000 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b73820f8-f69e-4f7e-989a-11dcaebf286d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1292 microversion: 2.1 time: 0.085697 Oct 27 17:34:38.002634 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 270/505] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:37 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:38.864026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-37950fdf-029a-44fd-8d81-d672242072f9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:38.864635 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-37950fdf-029a-44fd-8d81-d672242072f9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:38.871005 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-37950fdf-029a-44fd-8d81-d672242072f9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:38.871497 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-37950fdf-029a-44fd-8d81-d672242072f9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:38.871954 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-37950fdf-029a-44fd-8d81-d672242072f9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:38.872648 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-37950fdf-029a-44fd-8d81-d672242072f9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:38.873098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-37950fdf-029a-44fd-8d81-d672242072f9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:38.873518 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-37950fdf-029a-44fd-8d81-d672242072f9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:39.022063 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-869e26c4-b357-4eb9-88c8-1b69241dfb06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:39.023003 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-869e26c4-b357-4eb9-88c8-1b69241dfb06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:39.037356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-869e26c4-b357-4eb9-88c8-1b69241dfb06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:39.037999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-869e26c4-b357-4eb9-88c8-1b69241dfb06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:39.038832 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-869e26c4-b357-4eb9-88c8-1b69241dfb06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:39.039787 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-869e26c4-b357-4eb9-88c8-1b69241dfb06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:39.040830 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-869e26c4-b357-4eb9-88c8-1b69241dfb06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:39.044280 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-869e26c4-b357-4eb9-88c8-1b69241dfb06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:39.108008 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-37950fdf-029a-44fd-8d81-d672242072f9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:39.118234 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-37950fdf-029a-44fd-8d81-d672242072f9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:39.121012 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-37950fdf-029a-44fd-8d81-d672242072f9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:39.122353 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-37950fdf-029a-44fd-8d81-d672242072f9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.262341 Oct 27 17:34:39.123780 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 236/506] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:38 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:39.129315 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-90c5d38b-dc95-402e-af0b-673bdb877713 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:39.130153 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-90c5d38b-dc95-402e-af0b-673bdb877713 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:39.139463 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90c5d38b-dc95-402e-af0b-673bdb877713 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:39.140434 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90c5d38b-dc95-402e-af0b-673bdb877713 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:39.141113 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90c5d38b-dc95-402e-af0b-673bdb877713 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:39.142204 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90c5d38b-dc95-402e-af0b-673bdb877713 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:39.142826 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90c5d38b-dc95-402e-af0b-673bdb877713 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:39.143419 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90c5d38b-dc95-402e-af0b-673bdb877713 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:39.216136 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-869e26c4-b357-4eb9-88c8-1b69241dfb06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:39.225218 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-869e26c4-b357-4eb9-88c8-1b69241dfb06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1273 microversion: 2.1 time: 0.209227 Oct 27 17:34:39.225958 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 271/507] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:39 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:39.389817 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-90c5d38b-dc95-402e-af0b-673bdb877713 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:39.397871 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-90c5d38b-dc95-402e-af0b-673bdb877713 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1366 microversion: 2.1 time: 0.272939 Oct 27 17:34:39.407917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 237/508] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:39 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:39.840607 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-ba97c22a-a733-4579-9737-e033a8f99aee req-29ab87ae-d4bf-42c0-b1af-e04461dbb6cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50b532a6-30c9-44d5-b680-2e6bc6b2c41a", "tag": "e8441a6d-549a-4734-aaa6-21d018ed2a33"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:39.850023 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-ba97c22a-a733-4579-9737-e033a8f99aee req-29ab87ae-d4bf-42c0-b1af-e04461dbb6cb service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:39.850496 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-ba97c22a-a733-4579-9737-e033a8f99aee req-29ab87ae-d4bf-42c0-b1af-e04461dbb6cb service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:39.850922 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-ba97c22a-a733-4579-9737-e033a8f99aee req-29ab87ae-d4bf-42c0-b1af-e04461dbb6cb service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:39.863287 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-ba97c22a-a733-4579-9737-e033a8f99aee req-29ab87ae-d4bf-42c0-b1af-e04461dbb6cb service nova] Creating event network-changed:e8441a6d-549a-4734-aaa6-21d018ed2a33 for instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a on hv-cinder-86283 Oct 27 17:34:39.868860 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-ba97c22a-a733-4579-9737-e033a8f99aee req-29ab87ae-d4bf-42c0-b1af-e04461dbb6cb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031965 Oct 27 17:34:39.869453 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 272/509] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:34:40.150780 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7c4400af-e8a7-41f7-a452-0d571857608e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:40.151383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7c4400af-e8a7-41f7-a452-0d571857608e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:40.157705 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7c4400af-e8a7-41f7-a452-0d571857608e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:40.158177 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7c4400af-e8a7-41f7-a452-0d571857608e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:40.158603 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7c4400af-e8a7-41f7-a452-0d571857608e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:40.159273 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7c4400af-e8a7-41f7-a452-0d571857608e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:40.159734 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7c4400af-e8a7-41f7-a452-0d571857608e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:40.160146 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7c4400af-e8a7-41f7-a452-0d571857608e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:40.250465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-23b32713-2a4d-4c2b-8a3b-b58b9b28a728 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:40.251852 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-23b32713-2a4d-4c2b-8a3b-b58b9b28a728 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:40.258061 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-23b32713-2a4d-4c2b-8a3b-b58b9b28a728 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:40.258573 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-23b32713-2a4d-4c2b-8a3b-b58b9b28a728 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:40.259006 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-23b32713-2a4d-4c2b-8a3b-b58b9b28a728 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:40.259702 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-23b32713-2a4d-4c2b-8a3b-b58b9b28a728 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:40.260176 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-23b32713-2a4d-4c2b-8a3b-b58b9b28a728 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:40.260595 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-23b32713-2a4d-4c2b-8a3b-b58b9b28a728 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:40.289869 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7c4400af-e8a7-41f7-a452-0d571857608e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:40.298567 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7c4400af-e8a7-41f7-a452-0d571857608e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:40.300022 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7c4400af-e8a7-41f7-a452-0d571857608e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:40.301351 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7c4400af-e8a7-41f7-a452-0d571857608e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.154415 Oct 27 17:34:40.301908 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 238/510] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:40 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:40.393148 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-23b32713-2a4d-4c2b-8a3b-b58b9b28a728 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:40.400867 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-23b32713-2a4d-4c2b-8a3b-b58b9b28a728 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1273 microversion: 2.1 time: 0.155450 Oct 27 17:34:40.401428 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 273/511] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:40 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:40.421278 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-44b1b3d0-8363-4cd7-ab1a-fc8f1f607981 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:40.421880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-44b1b3d0-8363-4cd7-ab1a-fc8f1f607981 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:40.428417 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44b1b3d0-8363-4cd7-ab1a-fc8f1f607981 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:40.428896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44b1b3d0-8363-4cd7-ab1a-fc8f1f607981 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:40.429323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44b1b3d0-8363-4cd7-ab1a-fc8f1f607981 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:40.429993 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44b1b3d0-8363-4cd7-ab1a-fc8f1f607981 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:40.430443 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44b1b3d0-8363-4cd7-ab1a-fc8f1f607981 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:40.430855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44b1b3d0-8363-4cd7-ab1a-fc8f1f607981 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:40.555456 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-44b1b3d0-8363-4cd7-ab1a-fc8f1f607981 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:40.563171 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-44b1b3d0-8363-4cd7-ab1a-fc8f1f607981 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1366 microversion: 2.1 time: 0.145712 Oct 27 17:34:40.563753 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 239/512] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:40 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:41.328274 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a91389f4-5dac-46e5-9abc-d748aa466044 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:41.329677 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a91389f4-5dac-46e5-9abc-d748aa466044 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:41.336250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a91389f4-5dac-46e5-9abc-d748aa466044 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:41.336734 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a91389f4-5dac-46e5-9abc-d748aa466044 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:41.337196 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a91389f4-5dac-46e5-9abc-d748aa466044 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:41.337898 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a91389f4-5dac-46e5-9abc-d748aa466044 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:41.338351 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a91389f4-5dac-46e5-9abc-d748aa466044 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:41.338800 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a91389f4-5dac-46e5-9abc-d748aa466044 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:41.424591 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-62acc621-233e-4abb-8845-7e611bb97e57 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:41.425200 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-62acc621-233e-4abb-8845-7e611bb97e57 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:41.432080 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62acc621-233e-4abb-8845-7e611bb97e57 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:41.432567 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62acc621-233e-4abb-8845-7e611bb97e57 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:41.432995 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62acc621-233e-4abb-8845-7e611bb97e57 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:41.433691 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62acc621-233e-4abb-8845-7e611bb97e57 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:41.434142 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62acc621-233e-4abb-8845-7e611bb97e57 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:41.434562 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62acc621-233e-4abb-8845-7e611bb97e57 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:41.477662 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a91389f4-5dac-46e5-9abc-d748aa466044 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:41.486513 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a91389f4-5dac-46e5-9abc-d748aa466044 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:41.488100 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a91389f4-5dac-46e5-9abc-d748aa466044 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:41.489246 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a91389f4-5dac-46e5-9abc-d748aa466044 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.165412 Oct 27 17:34:41.489804 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 274/513] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:41 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:41.571668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-62acc621-233e-4abb-8845-7e611bb97e57 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:41.579995 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-62acc621-233e-4abb-8845-7e611bb97e57 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1273 microversion: 2.1 time: 0.159459 Oct 27 17:34:41.580565 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 240/514] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:41 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:41.585469 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-63299be4-77b4-4398-91cc-84797422120d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:41.586111 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-63299be4-77b4-4398-91cc-84797422120d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:41.591982 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63299be4-77b4-4398-91cc-84797422120d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:41.592458 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63299be4-77b4-4398-91cc-84797422120d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:41.592891 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63299be4-77b4-4398-91cc-84797422120d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:41.593598 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63299be4-77b4-4398-91cc-84797422120d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:41.594049 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63299be4-77b4-4398-91cc-84797422120d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:41.594524 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-63299be4-77b4-4398-91cc-84797422120d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:41.720676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-63299be4-77b4-4398-91cc-84797422120d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:41.728297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-63299be4-77b4-4398-91cc-84797422120d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1366 microversion: 2.1 time: 0.146722 Oct 27 17:34:41.729118 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 275/515] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:41 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:42.289159 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-860d55a7-fc38-471f-aade-87ca6a910f23 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:42.295471 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-860d55a7-fc38-471f-aade-87ca6a910f23 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:42.295988 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-860d55a7-fc38-471f-aade-87ca6a910f23 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:42.296453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-860d55a7-fc38-471f-aade-87ca6a910f23 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:42.358306 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-860d55a7-fc38-471f-aade-87ca6a910f23 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Going to try to stop instance {{(pid=119046) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 17:34:42.403284 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-860d55a7-fc38-471f-aade-87ca6a910f23 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "POST /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/action" status: 202 len: 0 microversion: 2.1 time: 0.117651 Oct 27 17:34:42.404476 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 241/516] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Oct 27 17:34:42 2022] POST /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:34:42.412426 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a1aef40e-94ac-4575-ad39-dbe59b0b70be tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:42.413811 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a1aef40e-94ac-4575-ad39-dbe59b0b70be tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:42.423597 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a1aef40e-94ac-4575-ad39-dbe59b0b70be tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:42.424293 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a1aef40e-94ac-4575-ad39-dbe59b0b70be tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:42.425025 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a1aef40e-94ac-4575-ad39-dbe59b0b70be tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:42.425750 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a1aef40e-94ac-4575-ad39-dbe59b0b70be tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:42.426358 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a1aef40e-94ac-4575-ad39-dbe59b0b70be tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:42.426793 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a1aef40e-94ac-4575-ad39-dbe59b0b70be tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:42.515406 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-5a2c277a-6869-41a9-bb91-5cbc2fbc7456 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:42.516193 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-5a2c277a-6869-41a9-bb91-5cbc2fbc7456 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:42.522430 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a2c277a-6869-41a9-bb91-5cbc2fbc7456 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:42.522980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a2c277a-6869-41a9-bb91-5cbc2fbc7456 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:42.523474 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a2c277a-6869-41a9-bb91-5cbc2fbc7456 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:42.524260 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a2c277a-6869-41a9-bb91-5cbc2fbc7456 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:42.524794 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a2c277a-6869-41a9-bb91-5cbc2fbc7456 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:42.525195 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a2c277a-6869-41a9-bb91-5cbc2fbc7456 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:42.561372 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a1aef40e-94ac-4575-ad39-dbe59b0b70be tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:42.572272 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a1aef40e-94ac-4575-ad39-dbe59b0b70be tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1722 microversion: 2.1 time: 0.163653 Oct 27 17:34:42.579805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 276/517] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:42 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:42.602512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-02dee9bf-eff9-4c37-8879-78f75a176f53 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:42.603131 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-02dee9bf-eff9-4c37-8879-78f75a176f53 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:42.610547 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-02dee9bf-eff9-4c37-8879-78f75a176f53 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:42.611365 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-02dee9bf-eff9-4c37-8879-78f75a176f53 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:42.611830 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-02dee9bf-eff9-4c37-8879-78f75a176f53 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:42.612517 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-02dee9bf-eff9-4c37-8879-78f75a176f53 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:42.612962 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-02dee9bf-eff9-4c37-8879-78f75a176f53 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:42.613379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-02dee9bf-eff9-4c37-8879-78f75a176f53 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:42.732421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5a2c277a-6869-41a9-bb91-5cbc2fbc7456 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:42.743552 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5a2c277a-6869-41a9-bb91-5cbc2fbc7456 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:42.745414 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5a2c277a-6869-41a9-bb91-5cbc2fbc7456 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:42.746833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-5a2c277a-6869-41a9-bb91-5cbc2fbc7456 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1744 microversion: 2.20 time: 0.236061 Oct 27 17:34:42.747471 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 242/518] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:42 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1744 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:34:42.751978 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7e278280-c665-49e2-a760-6701bc834740 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:42.752642 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7e278280-c665-49e2-a760-6701bc834740 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:42.758571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7e278280-c665-49e2-a760-6701bc834740 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:42.759122 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7e278280-c665-49e2-a760-6701bc834740 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:42.759625 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7e278280-c665-49e2-a760-6701bc834740 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:42.760414 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7e278280-c665-49e2-a760-6701bc834740 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:42.760990 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7e278280-c665-49e2-a760-6701bc834740 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:42.761484 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7e278280-c665-49e2-a760-6701bc834740 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:42.770518 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-02dee9bf-eff9-4c37-8879-78f75a176f53 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:42.778451 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-02dee9bf-eff9-4c37-8879-78f75a176f53 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1273 microversion: 2.1 time: 0.179927 Oct 27 17:34:42.779027 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 277/519] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:42 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1273 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:42.888540 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7e278280-c665-49e2-a760-6701bc834740 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:42.896335 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7e278280-c665-49e2-a760-6701bc834740 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1366 microversion: 2.1 time: 0.147791 Oct 27 17:34:42.896902 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 243/520] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:42 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:43.596409 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-377644ad-1fa0-4894-aeb4-a0ffae734bd4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:43.597012 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-377644ad-1fa0-4894-aeb4-a0ffae734bd4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:43.603477 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-377644ad-1fa0-4894-aeb4-a0ffae734bd4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:43.604241 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-377644ad-1fa0-4894-aeb4-a0ffae734bd4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:43.604672 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-377644ad-1fa0-4894-aeb4-a0ffae734bd4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:43.605359 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-377644ad-1fa0-4894-aeb4-a0ffae734bd4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:43.605810 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-377644ad-1fa0-4894-aeb4-a0ffae734bd4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:43.606233 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-377644ad-1fa0-4894-aeb4-a0ffae734bd4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:43.621427 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=100 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:34:43.737376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-377644ad-1fa0-4894-aeb4-a0ffae734bd4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:43.745590 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-377644ad-1fa0-4894-aeb4-a0ffae734bd4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1722 microversion: 2.1 time: 0.153705 Oct 27 17:34:43.746154 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 278/521] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:43 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:43.773108 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-64aa36c2-92fc-480e-99c0-e8313b3d18d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:43.773721 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-64aa36c2-92fc-480e-99c0-e8313b3d18d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:43.780440 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-64aa36c2-92fc-480e-99c0-e8313b3d18d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:43.780921 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-64aa36c2-92fc-480e-99c0-e8313b3d18d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:43.781350 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-64aa36c2-92fc-480e-99c0-e8313b3d18d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:43.782707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-64aa36c2-92fc-480e-99c0-e8313b3d18d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:43.783160 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-64aa36c2-92fc-480e-99c0-e8313b3d18d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:43.783581 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-64aa36c2-92fc-480e-99c0-e8313b3d18d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:43.801458 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-01a3611e-4c8f-49e4-bba8-9fd4bae47967 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:43.802004 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-01a3611e-4c8f-49e4-bba8-9fd4bae47967 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:43.807877 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01a3611e-4c8f-49e4-bba8-9fd4bae47967 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:43.808359 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01a3611e-4c8f-49e4-bba8-9fd4bae47967 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:43.808792 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01a3611e-4c8f-49e4-bba8-9fd4bae47967 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:43.809487 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01a3611e-4c8f-49e4-bba8-9fd4bae47967 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:43.809949 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01a3611e-4c8f-49e4-bba8-9fd4bae47967 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:43.810358 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01a3611e-4c8f-49e4-bba8-9fd4bae47967 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:43.913823 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-64aa36c2-92fc-480e-99c0-e8313b3d18d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:43.916386 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:34:43.924300 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-64aa36c2-92fc-480e-99c0-e8313b3d18d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:43.925740 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-64aa36c2-92fc-480e-99c0-e8313b3d18d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:43.926887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-64aa36c2-92fc-480e-99c0-e8313b3d18d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1744 microversion: 2.20 time: 0.157660 Oct 27 17:34:43.927445 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 244/522] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:43 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:43.932110 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b043c392-42d3-41b2-be33-9e3309524051 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:43.932713 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b043c392-42d3-41b2-be33-9e3309524051 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:43.938411 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b043c392-42d3-41b2-be33-9e3309524051 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:43.938899 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b043c392-42d3-41b2-be33-9e3309524051 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:43.939328 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b043c392-42d3-41b2-be33-9e3309524051 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:43.940042 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b043c392-42d3-41b2-be33-9e3309524051 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:43.940494 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b043c392-42d3-41b2-be33-9e3309524051 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:43.940914 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b043c392-42d3-41b2-be33-9e3309524051 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:43.943150 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-01a3611e-4c8f-49e4-bba8-9fd4bae47967 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:43.950817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-01a3611e-4c8f-49e4-bba8-9fd4bae47967 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1273 microversion: 2.1 time: 0.153251 Oct 27 17:34:43.951597 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 279/523] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:43 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:44.068064 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b043c392-42d3-41b2-be33-9e3309524051 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:44.075468 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b043c392-42d3-41b2-be33-9e3309524051 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1366 microversion: 2.1 time: 0.147068 Oct 27 17:34:44.076059 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 245/524] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:43 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:44.768042 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f369ea38-fdc2-43d1-b475-b35edc39f123 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:44.768772 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f369ea38-fdc2-43d1-b475-b35edc39f123 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:44.770800 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=6 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:34:44.777052 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f369ea38-fdc2-43d1-b475-b35edc39f123 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:44.777541 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f369ea38-fdc2-43d1-b475-b35edc39f123 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:44.777980 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f369ea38-fdc2-43d1-b475-b35edc39f123 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:44.778679 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f369ea38-fdc2-43d1-b475-b35edc39f123 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:44.779135 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f369ea38-fdc2-43d1-b475-b35edc39f123 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:44.779560 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f369ea38-fdc2-43d1-b475-b35edc39f123 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:44.913499 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f369ea38-fdc2-43d1-b475-b35edc39f123 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:44.921584 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f369ea38-fdc2-43d1-b475-b35edc39f123 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1722 microversion: 2.1 time: 0.157474 Oct 27 17:34:44.922158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 280/525] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:44 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:44.952639 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2d328ff6-e427-4aae-832e-70a6402226b8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:44.953186 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2d328ff6-e427-4aae-832e-70a6402226b8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:44.959647 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2d328ff6-e427-4aae-832e-70a6402226b8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:44.960153 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2d328ff6-e427-4aae-832e-70a6402226b8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:44.960583 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2d328ff6-e427-4aae-832e-70a6402226b8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:44.961261 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2d328ff6-e427-4aae-832e-70a6402226b8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:44.961709 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2d328ff6-e427-4aae-832e-70a6402226b8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:44.962125 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2d328ff6-e427-4aae-832e-70a6402226b8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:44.975018 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-e1d36e35-60c3-4371-9e3d-4d05d96c419d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:44.975828 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e1d36e35-60c3-4371-9e3d-4d05d96c419d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:44.983004 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e1d36e35-60c3-4371-9e3d-4d05d96c419d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:44.983621 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e1d36e35-60c3-4371-9e3d-4d05d96c419d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:44.984152 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e1d36e35-60c3-4371-9e3d-4d05d96c419d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:44.984851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e1d36e35-60c3-4371-9e3d-4d05d96c419d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:44.985866 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e1d36e35-60c3-4371-9e3d-4d05d96c419d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:44.986290 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e1d36e35-60c3-4371-9e3d-4d05d96c419d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:45.106942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2d328ff6-e427-4aae-832e-70a6402226b8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:45.115621 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2d328ff6-e427-4aae-832e-70a6402226b8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:45.117070 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2d328ff6-e427-4aae-832e-70a6402226b8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:45.118226 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2d328ff6-e427-4aae-832e-70a6402226b8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1744 microversion: 2.20 time: 0.169542 Oct 27 17:34:45.118788 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 246/526] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:44 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:45.123254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-05fd1ada-2be4-4d07-b71a-70d9cc764d86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:45.124011 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-05fd1ada-2be4-4d07-b71a-70d9cc764d86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:45.124216 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e1d36e35-60c3-4371-9e3d-4d05d96c419d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:45.129843 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-05fd1ada-2be4-4d07-b71a-70d9cc764d86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:45.130327 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-05fd1ada-2be4-4d07-b71a-70d9cc764d86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:45.130758 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-05fd1ada-2be4-4d07-b71a-70d9cc764d86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:45.131577 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-05fd1ada-2be4-4d07-b71a-70d9cc764d86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:45.132059 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-05fd1ada-2be4-4d07-b71a-70d9cc764d86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:45.132476 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-05fd1ada-2be4-4d07-b71a-70d9cc764d86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:45.132579 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-e1d36e35-60c3-4371-9e3d-4d05d96c419d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1273 microversion: 2.1 time: 0.161242 Oct 27 17:34:45.133400 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 281/527] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:44 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1273 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:45.267295 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-05fd1ada-2be4-4d07-b71a-70d9cc764d86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:45.274848 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-05fd1ada-2be4-4d07-b71a-70d9cc764d86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1366 microversion: 2.1 time: 0.155121 Oct 27 17:34:45.275411 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 247/528] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:45 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:45.945508 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-836abb11-5544-4548-ae7b-f475c832ee62 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:45.946039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-836abb11-5544-4548-ae7b-f475c832ee62 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:45.952440 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-836abb11-5544-4548-ae7b-f475c832ee62 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:45.952922 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-836abb11-5544-4548-ae7b-f475c832ee62 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:45.953359 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-836abb11-5544-4548-ae7b-f475c832ee62 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:45.954607 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-836abb11-5544-4548-ae7b-f475c832ee62 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:45.955057 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-836abb11-5544-4548-ae7b-f475c832ee62 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:45.955478 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-836abb11-5544-4548-ae7b-f475c832ee62 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:46.082302 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-836abb11-5544-4548-ae7b-f475c832ee62 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:46.090480 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-836abb11-5544-4548-ae7b-f475c832ee62 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1722 microversion: 2.1 time: 0.148926 Oct 27 17:34:46.091043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 282/529] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:45 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:46.144283 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-21c66620-9d6a-4925-99cb-0339f9f3b61b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:46.144889 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-21c66620-9d6a-4925-99cb-0339f9f3b61b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:46.152430 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-21c66620-9d6a-4925-99cb-0339f9f3b61b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:46.152908 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-21c66620-9d6a-4925-99cb-0339f9f3b61b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:46.153340 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-21c66620-9d6a-4925-99cb-0339f9f3b61b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:46.154026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-21c66620-9d6a-4925-99cb-0339f9f3b61b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:46.154177 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-821bca3a-5bfa-4edf-aa0a-44895f0f672e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:46.154475 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-21c66620-9d6a-4925-99cb-0339f9f3b61b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:46.154781 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-821bca3a-5bfa-4edf-aa0a-44895f0f672e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:46.154884 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-21c66620-9d6a-4925-99cb-0339f9f3b61b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:46.161253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-821bca3a-5bfa-4edf-aa0a-44895f0f672e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:46.161725 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-821bca3a-5bfa-4edf-aa0a-44895f0f672e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:46.162157 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-821bca3a-5bfa-4edf-aa0a-44895f0f672e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:46.162834 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-821bca3a-5bfa-4edf-aa0a-44895f0f672e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:46.163277 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-821bca3a-5bfa-4edf-aa0a-44895f0f672e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:46.163692 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-821bca3a-5bfa-4edf-aa0a-44895f0f672e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:46.286411 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-21c66620-9d6a-4925-99cb-0339f9f3b61b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:46.295375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-21c66620-9d6a-4925-99cb-0339f9f3b61b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:46.296053 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-821bca3a-5bfa-4edf-aa0a-44895f0f672e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:46.296851 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-21c66620-9d6a-4925-99cb-0339f9f3b61b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:46.298030 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-21c66620-9d6a-4925-99cb-0339f9f3b61b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1744 microversion: 2.20 time: 0.158239 Oct 27 17:34:46.298596 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 248/530] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:46 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:46.302972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-88904241-c674-4aa1-a8e4-204f8809dc0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:46.303574 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-88904241-c674-4aa1-a8e4-204f8809dc0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:46.304216 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-821bca3a-5bfa-4edf-aa0a-44895f0f672e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1273 microversion: 2.1 time: 0.153729 Oct 27 17:34:46.305147 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 283/531] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:46 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:46.309446 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-88904241-c674-4aa1-a8e4-204f8809dc0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:46.309992 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-88904241-c674-4aa1-a8e4-204f8809dc0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:46.310486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-88904241-c674-4aa1-a8e4-204f8809dc0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:46.311271 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-88904241-c674-4aa1-a8e4-204f8809dc0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:46.311878 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-88904241-c674-4aa1-a8e4-204f8809dc0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:46.312340 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-88904241-c674-4aa1-a8e4-204f8809dc0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:46.442059 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-88904241-c674-4aa1-a8e4-204f8809dc0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:46.449676 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-88904241-c674-4aa1-a8e4-204f8809dc0a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1366 microversion: 2.1 time: 0.150149 Oct 27 17:34:46.450241 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 249/532] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:46 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:46.859469 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-cce049c6-453f-413d-b5b2-c917df332cce req-db91e3d7-474d-44f2-8f67-ad30effe10ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b27a822-4c22-45f0-872b-67e5f360f45e", "name": "network-vif-plugged", "status": "completed", "tag": "8d525473-0013-4431-baf7-e343fbc1a2eb"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:46.869673 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-cce049c6-453f-413d-b5b2-c917df332cce req-db91e3d7-474d-44f2-8f67-ad30effe10ad service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:46.870153 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-cce049c6-453f-413d-b5b2-c917df332cce req-db91e3d7-474d-44f2-8f67-ad30effe10ad service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:46.870577 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-cce049c6-453f-413d-b5b2-c917df332cce req-db91e3d7-474d-44f2-8f67-ad30effe10ad service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:46.883830 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-cce049c6-453f-413d-b5b2-c917df332cce req-db91e3d7-474d-44f2-8f67-ad30effe10ad service nova] Creating event network-vif-plugged:8d525473-0013-4431-baf7-e343fbc1a2eb for instance 2b27a822-4c22-45f0-872b-67e5f360f45e on hv-cinder-86283 Oct 27 17:34:46.890420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-cce049c6-453f-413d-b5b2-c917df332cce req-db91e3d7-474d-44f2-8f67-ad30effe10ad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034485 Oct 27 17:34:46.891332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 284/533] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:34:47.114282 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7615d5f8-4f6c-46c7-8cac-8b49470116a4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:47.114829 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7615d5f8-4f6c-46c7-8cac-8b49470116a4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:47.116697 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=4 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:34:47.117367 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=14 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:34:47.123019 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7615d5f8-4f6c-46c7-8cac-8b49470116a4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:47.123491 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7615d5f8-4f6c-46c7-8cac-8b49470116a4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:47.123946 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7615d5f8-4f6c-46c7-8cac-8b49470116a4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:47.124618 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7615d5f8-4f6c-46c7-8cac-8b49470116a4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:47.125061 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7615d5f8-4f6c-46c7-8cac-8b49470116a4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:47.125479 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7615d5f8-4f6c-46c7-8cac-8b49470116a4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:47.251997 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7615d5f8-4f6c-46c7-8cac-8b49470116a4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:47.260090 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7615d5f8-4f6c-46c7-8cac-8b49470116a4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1722 microversion: 2.1 time: 0.150117 Oct 27 17:34:47.260663 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 250/534] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:47 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:47.325086 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-812bd759-e360-41d0-8e2f-de4f35a09dfa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:47.325940 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-812bd759-e360-41d0-8e2f-de4f35a09dfa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:47.326438 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0296a393-ad02-487b-9308-cb4e592a9114 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:47.327101 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-0296a393-ad02-487b-9308-cb4e592a9114 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:47.332856 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-812bd759-e360-41d0-8e2f-de4f35a09dfa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:47.333336 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-812bd759-e360-41d0-8e2f-de4f35a09dfa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:47.333612 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0296a393-ad02-487b-9308-cb4e592a9114 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:47.333768 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-812bd759-e360-41d0-8e2f-de4f35a09dfa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:47.334094 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0296a393-ad02-487b-9308-cb4e592a9114 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:47.334457 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-812bd759-e360-41d0-8e2f-de4f35a09dfa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:47.334556 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0296a393-ad02-487b-9308-cb4e592a9114 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:47.334907 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-812bd759-e360-41d0-8e2f-de4f35a09dfa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:47.335195 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0296a393-ad02-487b-9308-cb4e592a9114 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:47.335313 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-812bd759-e360-41d0-8e2f-de4f35a09dfa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:47.335644 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0296a393-ad02-487b-9308-cb4e592a9114 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:47.336089 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0296a393-ad02-487b-9308-cb4e592a9114 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:47.466736 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-812bd759-e360-41d0-8e2f-de4f35a09dfa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:47.470299 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0296a393-ad02-487b-9308-cb4e592a9114 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:47.475455 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-812bd759-e360-41d0-8e2f-de4f35a09dfa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:47.477027 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-812bd759-e360-41d0-8e2f-de4f35a09dfa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:47.478126 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0296a393-ad02-487b-9308-cb4e592a9114 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1261 microversion: 2.1 time: 0.155776 Oct 27 17:34:47.478321 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-812bd759-e360-41d0-8e2f-de4f35a09dfa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1744 microversion: 2.20 time: 0.158036 Oct 27 17:34:47.478964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 251/535] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:47 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:47.479306 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 285/536] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:47 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:47.483580 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-93a7f55b-ec35-4388-9b47-5209a56b2e13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:47.484237 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-93a7f55b-ec35-4388-9b47-5209a56b2e13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:47.490463 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-93a7f55b-ec35-4388-9b47-5209a56b2e13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:47.490940 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-93a7f55b-ec35-4388-9b47-5209a56b2e13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:47.491372 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-93a7f55b-ec35-4388-9b47-5209a56b2e13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:47.492205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-93a7f55b-ec35-4388-9b47-5209a56b2e13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:47.492655 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-93a7f55b-ec35-4388-9b47-5209a56b2e13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:47.493071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-93a7f55b-ec35-4388-9b47-5209a56b2e13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:47.621808 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-93a7f55b-ec35-4388-9b47-5209a56b2e13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:47.629967 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-93a7f55b-ec35-4388-9b47-5209a56b2e13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1366 microversion: 2.1 time: 0.150074 Oct 27 17:34:47.630541 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 252/537] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:47 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:48.284271 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-75975c6b-c4ea-4c79-9d0c-555ef8728746 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:48.284886 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-75975c6b-c4ea-4c79-9d0c-555ef8728746 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:48.290859 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75975c6b-c4ea-4c79-9d0c-555ef8728746 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:48.291338 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75975c6b-c4ea-4c79-9d0c-555ef8728746 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:48.291803 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75975c6b-c4ea-4c79-9d0c-555ef8728746 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:48.292489 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75975c6b-c4ea-4c79-9d0c-555ef8728746 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:48.292943 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75975c6b-c4ea-4c79-9d0c-555ef8728746 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:48.293371 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75975c6b-c4ea-4c79-9d0c-555ef8728746 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:48.422133 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-75975c6b-c4ea-4c79-9d0c-555ef8728746 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:48.430774 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-75975c6b-c4ea-4c79-9d0c-555ef8728746 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1722 microversion: 2.1 time: 0.150402 Oct 27 17:34:48.431351 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 286/538] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:48 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:48.502444 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-cce68735-8095-4475-838e-3d86357842a1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:48.503054 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-cce68735-8095-4475-838e-3d86357842a1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:48.504228 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b3fda377-962d-4e6c-94ba-d4ced8d70fed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:48.504842 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b3fda377-962d-4e6c-94ba-d4ced8d70fed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:48.505360 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:34:48.510622 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cce68735-8095-4475-838e-3d86357842a1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:48.510885 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b3fda377-962d-4e6c-94ba-d4ced8d70fed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:48.511102 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cce68735-8095-4475-838e-3d86357842a1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:48.511366 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b3fda377-962d-4e6c-94ba-d4ced8d70fed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:48.511540 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cce68735-8095-4475-838e-3d86357842a1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:48.511837 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b3fda377-962d-4e6c-94ba-d4ced8d70fed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:48.512258 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cce68735-8095-4475-838e-3d86357842a1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:48.512529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b3fda377-962d-4e6c-94ba-d4ced8d70fed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:48.512712 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cce68735-8095-4475-838e-3d86357842a1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:48.512974 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b3fda377-962d-4e6c-94ba-d4ced8d70fed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:48.513134 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cce68735-8095-4475-838e-3d86357842a1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:48.513388 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b3fda377-962d-4e6c-94ba-d4ced8d70fed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:48.642006 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-b3fda377-962d-4e6c-94ba-d4ced8d70fed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:48.644070 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-cce68735-8095-4475-838e-3d86357842a1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:48.651623 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-cce68735-8095-4475-838e-3d86357842a1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1261 microversion: 2.1 time: 0.153766 Oct 27 17:34:48.651970 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-b3fda377-962d-4e6c-94ba-d4ced8d70fed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:48.652379 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 253/539] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:48 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:48.653728 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-b3fda377-962d-4e6c-94ba-d4ced8d70fed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:48.654894 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b3fda377-962d-4e6c-94ba-d4ced8d70fed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1744 microversion: 2.20 time: 0.155092 Oct 27 17:34:48.656565 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6496b777-264b-4ef4-8ae2-5dda4ba9f3e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:48.657698 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6496b777-264b-4ef4-8ae2-5dda4ba9f3e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:48.663353 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6496b777-264b-4ef4-8ae2-5dda4ba9f3e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:48.663859 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6496b777-264b-4ef4-8ae2-5dda4ba9f3e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:48.664297 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6496b777-264b-4ef4-8ae2-5dda4ba9f3e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:48.664975 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6496b777-264b-4ef4-8ae2-5dda4ba9f3e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:48.665432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6496b777-264b-4ef4-8ae2-5dda4ba9f3e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:48.665846 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6496b777-264b-4ef4-8ae2-5dda4ba9f3e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:48.667784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 287/540] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:48 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:34:48.796720 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-6496b777-264b-4ef4-8ae2-5dda4ba9f3e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:48.804960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6496b777-264b-4ef4-8ae2-5dda4ba9f3e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1366 microversion: 2.1 time: 0.151798 Oct 27 17:34:48.805630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 254/541] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:48 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:49.454837 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0c257781-477c-4a0c-ac8e-a38eff710a81 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:49.455486 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-0c257781-477c-4a0c-ac8e-a38eff710a81 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:49.462051 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0c257781-477c-4a0c-ac8e-a38eff710a81 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:49.462538 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0c257781-477c-4a0c-ac8e-a38eff710a81 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:49.462978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0c257781-477c-4a0c-ac8e-a38eff710a81 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:49.463669 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0c257781-477c-4a0c-ac8e-a38eff710a81 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:49.464152 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0c257781-477c-4a0c-ac8e-a38eff710a81 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:49.464579 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0c257781-477c-4a0c-ac8e-a38eff710a81 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:49.595389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-0c257781-477c-4a0c-ac8e-a38eff710a81 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:49.603911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0c257781-477c-4a0c-ac8e-a38eff710a81 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1722 microversion: 2.1 time: 0.153242 Oct 27 17:34:49.605831 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 288/542] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:49 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:49.674882 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8fb4f0f1-f9d8-4a26-b6cd-8bee63836583 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:49.675555 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8fb4f0f1-f9d8-4a26-b6cd-8bee63836583 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:49.680748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d17af52d-48e0-4c80-bcb5-d337f3d4c04f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:49.681362 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d17af52d-48e0-4c80-bcb5-d337f3d4c04f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:49.682127 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8fb4f0f1-f9d8-4a26-b6cd-8bee63836583 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:49.682601 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8fb4f0f1-f9d8-4a26-b6cd-8bee63836583 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:49.683030 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8fb4f0f1-f9d8-4a26-b6cd-8bee63836583 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:49.683702 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8fb4f0f1-f9d8-4a26-b6cd-8bee63836583 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:49.684168 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8fb4f0f1-f9d8-4a26-b6cd-8bee63836583 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:49.684580 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8fb4f0f1-f9d8-4a26-b6cd-8bee63836583 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:49.687347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d17af52d-48e0-4c80-bcb5-d337f3d4c04f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:49.688374 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d17af52d-48e0-4c80-bcb5-d337f3d4c04f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:49.688817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d17af52d-48e0-4c80-bcb5-d337f3d4c04f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:49.689500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d17af52d-48e0-4c80-bcb5-d337f3d4c04f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:49.689954 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d17af52d-48e0-4c80-bcb5-d337f3d4c04f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:49.690386 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d17af52d-48e0-4c80-bcb5-d337f3d4c04f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:49.823594 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8fb4f0f1-f9d8-4a26-b6cd-8bee63836583 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:49.831896 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d17af52d-48e0-4c80-bcb5-d337f3d4c04f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:49.833530 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8fb4f0f1-f9d8-4a26-b6cd-8bee63836583 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1261 microversion: 2.1 time: 0.162438 Oct 27 17:34:49.835743 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 255/543] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:49 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:49.841156 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-840c6b10-ddef-4455-8764-d7ba632ce705 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:49.841522 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d17af52d-48e0-4c80-bcb5-d337f3d4c04f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:49.842323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-840c6b10-ddef-4455-8764-d7ba632ce705 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:49.842995 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d17af52d-48e0-4c80-bcb5-d337f3d4c04f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:49.844255 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d17af52d-48e0-4c80-bcb5-d337f3d4c04f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1744 microversion: 2.20 time: 0.167233 Oct 27 17:34:49.852978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 289/544] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:49 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:34:49.854916 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-840c6b10-ddef-4455-8764-d7ba632ce705 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:49.855403 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-840c6b10-ddef-4455-8764-d7ba632ce705 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:49.855861 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-840c6b10-ddef-4455-8764-d7ba632ce705 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:49.856558 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-840c6b10-ddef-4455-8764-d7ba632ce705 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:49.857003 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-840c6b10-ddef-4455-8764-d7ba632ce705 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:49.857419 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-840c6b10-ddef-4455-8764-d7ba632ce705 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:49.991999 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-840c6b10-ddef-4455-8764-d7ba632ce705 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:49.999497 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-840c6b10-ddef-4455-8764-d7ba632ce705 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1366 microversion: 2.1 time: 0.162446 Oct 27 17:34:50.000288 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 256/545] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:49 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:50.628978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-21509d8b-92f4-4be0-bb59-d7e7a195d220 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:50.629628 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-21509d8b-92f4-4be0-bb59-d7e7a195d220 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:50.636403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21509d8b-92f4-4be0-bb59-d7e7a195d220 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:50.636885 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21509d8b-92f4-4be0-bb59-d7e7a195d220 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:50.637321 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21509d8b-92f4-4be0-bb59-d7e7a195d220 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:50.638005 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21509d8b-92f4-4be0-bb59-d7e7a195d220 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:50.638509 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21509d8b-92f4-4be0-bb59-d7e7a195d220 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:50.638914 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21509d8b-92f4-4be0-bb59-d7e7a195d220 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:50.764501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-21509d8b-92f4-4be0-bb59-d7e7a195d220 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:50.772851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-21509d8b-92f4-4be0-bb59-d7e7a195d220 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1722 microversion: 2.1 time: 0.148389 Oct 27 17:34:50.773421 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 290/546] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:50 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:50.857545 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3f30b0fe-03b0-4de6-a2f5-81b19c227cd8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:50.858148 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-3f30b0fe-03b0-4de6-a2f5-81b19c227cd8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:50.864928 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3f30b0fe-03b0-4de6-a2f5-81b19c227cd8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:50.865640 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3f30b0fe-03b0-4de6-a2f5-81b19c227cd8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:50.865817 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3f30b0fe-03b0-4de6-a2f5-81b19c227cd8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:50.866491 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3f30b0fe-03b0-4de6-a2f5-81b19c227cd8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:50.866935 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3f30b0fe-03b0-4de6-a2f5-81b19c227cd8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:50.867348 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3f30b0fe-03b0-4de6-a2f5-81b19c227cd8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:50.870203 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-9e5a178f-2245-4ab9-b57b-e57f8de9d5d0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:50.870809 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-9e5a178f-2245-4ab9-b57b-e57f8de9d5d0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:50.873758 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:34:50.878156 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9e5a178f-2245-4ab9-b57b-e57f8de9d5d0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:50.878632 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9e5a178f-2245-4ab9-b57b-e57f8de9d5d0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:50.879058 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9e5a178f-2245-4ab9-b57b-e57f8de9d5d0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:50.879766 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9e5a178f-2245-4ab9-b57b-e57f8de9d5d0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:50.880219 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9e5a178f-2245-4ab9-b57b-e57f8de9d5d0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:50.880634 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9e5a178f-2245-4ab9-b57b-e57f8de9d5d0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:50.999469 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-3f30b0fe-03b0-4de6-a2f5-81b19c227cd8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:51.007650 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-3f30b0fe-03b0-4de6-a2f5-81b19c227cd8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1261 microversion: 2.1 time: 0.154151 Oct 27 17:34:51.008329 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 257/547] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:50 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:51.010242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9e5a178f-2245-4ab9-b57b-e57f8de9d5d0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:51.018791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9e5a178f-2245-4ab9-b57b-e57f8de9d5d0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:51.020261 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9e5a178f-2245-4ab9-b57b-e57f8de9d5d0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:51.021475 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-9e5a178f-2245-4ab9-b57b-e57f8de9d5d0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1744 microversion: 2.20 time: 0.155063 Oct 27 17:34:51.022184 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 291/548] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:50 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:51.022500 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8dfe03f1-3748-4244-8f19-8ba111168098 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:51.023179 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8dfe03f1-3748-4244-8f19-8ba111168098 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:51.028957 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8dfe03f1-3748-4244-8f19-8ba111168098 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:51.029545 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8dfe03f1-3748-4244-8f19-8ba111168098 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:51.029980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8dfe03f1-3748-4244-8f19-8ba111168098 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:51.030665 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8dfe03f1-3748-4244-8f19-8ba111168098 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:51.031105 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8dfe03f1-3748-4244-8f19-8ba111168098 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:51.032048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8dfe03f1-3748-4244-8f19-8ba111168098 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:51.157862 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8dfe03f1-3748-4244-8f19-8ba111168098 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:51.165968 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8dfe03f1-3748-4244-8f19-8ba111168098 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1366 microversion: 2.1 time: 0.147488 Oct 27 17:34:51.166803 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 258/549] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:51 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:51.417096 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-9d68585d-4f88-42c7-8b6d-e214f05f2409 req-09de7dfd-751a-43ba-81c2-5b51e342b220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50b532a6-30c9-44d5-b680-2e6bc6b2c41a", "name": "network-vif-plugged", "status": "completed", "tag": "e8441a6d-549a-4734-aaa6-21d018ed2a33"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:51.428283 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-9d68585d-4f88-42c7-8b6d-e214f05f2409 req-09de7dfd-751a-43ba-81c2-5b51e342b220 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:51.428760 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-9d68585d-4f88-42c7-8b6d-e214f05f2409 req-09de7dfd-751a-43ba-81c2-5b51e342b220 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:51.429189 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-9d68585d-4f88-42c7-8b6d-e214f05f2409 req-09de7dfd-751a-43ba-81c2-5b51e342b220 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:51.442643 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-9d68585d-4f88-42c7-8b6d-e214f05f2409 req-09de7dfd-751a-43ba-81c2-5b51e342b220 service nova] Creating event network-vif-plugged:e8441a6d-549a-4734-aaa6-21d018ed2a33 for instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a on hv-cinder-86283 Oct 27 17:34:51.447516 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-9d68585d-4f88-42c7-8b6d-e214f05f2409 req-09de7dfd-751a-43ba-81c2-5b51e342b220 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034192 Oct 27 17:34:51.448437 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 292/550] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:34:51.795420 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-cf0e6659-ebb6-4ca7-a4f9-47b9ac07bcb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:51.796090 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-cf0e6659-ebb6-4ca7-a4f9-47b9ac07bcb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:51.802582 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cf0e6659-ebb6-4ca7-a4f9-47b9ac07bcb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:51.803180 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cf0e6659-ebb6-4ca7-a4f9-47b9ac07bcb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:51.803648 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cf0e6659-ebb6-4ca7-a4f9-47b9ac07bcb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:51.804415 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cf0e6659-ebb6-4ca7-a4f9-47b9ac07bcb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:51.804879 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cf0e6659-ebb6-4ca7-a4f9-47b9ac07bcb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:51.805320 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cf0e6659-ebb6-4ca7-a4f9-47b9ac07bcb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:51.950870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-cf0e6659-ebb6-4ca7-a4f9-47b9ac07bcb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:51.961268 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-cf0e6659-ebb6-4ca7-a4f9-47b9ac07bcb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1722 microversion: 2.1 time: 0.169755 Oct 27 17:34:51.962065 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 259/551] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:51 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:52.031179 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c545a772-b341-4004-866c-3254c3737ad1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:52.031934 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c545a772-b341-4004-866c-3254c3737ad1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:52.038388 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c545a772-b341-4004-866c-3254c3737ad1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:52.038871 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c545a772-b341-4004-866c-3254c3737ad1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:52.039304 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c545a772-b341-4004-866c-3254c3737ad1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:52.040034 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c545a772-b341-4004-866c-3254c3737ad1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:52.040487 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c545a772-b341-4004-866c-3254c3737ad1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:52.040905 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c545a772-b341-4004-866c-3254c3737ad1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:52.046606 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-adff91ee-2bf5-4f71-a775-fc4a58aa72b4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:52.048230 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-adff91ee-2bf5-4f71-a775-fc4a58aa72b4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:52.057588 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-adff91ee-2bf5-4f71-a775-fc4a58aa72b4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:52.059240 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-adff91ee-2bf5-4f71-a775-fc4a58aa72b4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:52.060012 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-adff91ee-2bf5-4f71-a775-fc4a58aa72b4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:52.060928 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-adff91ee-2bf5-4f71-a775-fc4a58aa72b4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:52.061604 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-adff91ee-2bf5-4f71-a775-fc4a58aa72b4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:52.062270 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-adff91ee-2bf5-4f71-a775-fc4a58aa72b4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:52.192482 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c545a772-b341-4004-866c-3254c3737ad1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:52.201719 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c545a772-b341-4004-866c-3254c3737ad1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1261 microversion: 2.1 time: 0.175171 Oct 27 17:34:52.202885 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 293/552] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:52 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:52.207993 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-18067d99-f386-4875-9c96-410a1bf0ac13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:52.209069 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-18067d99-f386-4875-9c96-410a1bf0ac13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:52.215851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18067d99-f386-4875-9c96-410a1bf0ac13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:52.216648 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18067d99-f386-4875-9c96-410a1bf0ac13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:52.217335 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18067d99-f386-4875-9c96-410a1bf0ac13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:52.218250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18067d99-f386-4875-9c96-410a1bf0ac13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:52.218815 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18067d99-f386-4875-9c96-410a1bf0ac13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:52.219291 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18067d99-f386-4875-9c96-410a1bf0ac13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:52.226862 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-adff91ee-2bf5-4f71-a775-fc4a58aa72b4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:52.236002 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-adff91ee-2bf5-4f71-a775-fc4a58aa72b4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:52.237450 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-adff91ee-2bf5-4f71-a775-fc4a58aa72b4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:52.239977 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-adff91ee-2bf5-4f71-a775-fc4a58aa72b4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1739 microversion: 2.20 time: 0.196857 Oct 27 17:34:52.240339 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 260/553] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:52 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:52.371076 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-18067d99-f386-4875-9c96-410a1bf0ac13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:52.379479 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-18067d99-f386-4875-9c96-410a1bf0ac13 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1366 microversion: 2.1 time: 0.175139 Oct 27 17:34:52.380334 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 294/554] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:52 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:52.985490 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-403ad9bc-1c33-4eb2-affa-c98aecbe0f12 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:52.986146 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-403ad9bc-1c33-4eb2-affa-c98aecbe0f12 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:52.993692 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-403ad9bc-1c33-4eb2-affa-c98aecbe0f12 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:52.994157 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-403ad9bc-1c33-4eb2-affa-c98aecbe0f12 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:52.994577 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-403ad9bc-1c33-4eb2-affa-c98aecbe0f12 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:52.995262 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-403ad9bc-1c33-4eb2-affa-c98aecbe0f12 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:52.995728 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-403ad9bc-1c33-4eb2-affa-c98aecbe0f12 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:52.996160 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-403ad9bc-1c33-4eb2-affa-c98aecbe0f12 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:53.012442 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=100 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:34:53.142375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-403ad9bc-1c33-4eb2-affa-c98aecbe0f12 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:53.151053 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-403ad9bc-1c33-4eb2-affa-c98aecbe0f12 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1722 microversion: 2.1 time: 0.170019 Oct 27 17:34:53.151625 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 261/555] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:52 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:53.224966 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-3c6d8b3d-687e-4dac-862d-62a8117fd7ee tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:53.225606 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-3c6d8b3d-687e-4dac-862d-62a8117fd7ee tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:53.232404 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c6d8b3d-687e-4dac-862d-62a8117fd7ee tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:53.233209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c6d8b3d-687e-4dac-862d-62a8117fd7ee tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:53.233715 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c6d8b3d-687e-4dac-862d-62a8117fd7ee tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:53.234670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c6d8b3d-687e-4dac-862d-62a8117fd7ee tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:53.235196 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c6d8b3d-687e-4dac-862d-62a8117fd7ee tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:53.235787 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3c6d8b3d-687e-4dac-862d-62a8117fd7ee tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:53.267514 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a42d2d79-b113-4e36-af35-bdc207762748 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:53.268974 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a42d2d79-b113-4e36-af35-bdc207762748 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:53.279048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a42d2d79-b113-4e36-af35-bdc207762748 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:53.284440 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a42d2d79-b113-4e36-af35-bdc207762748 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:53.285153 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a42d2d79-b113-4e36-af35-bdc207762748 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:53.286074 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a42d2d79-b113-4e36-af35-bdc207762748 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:53.286900 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a42d2d79-b113-4e36-af35-bdc207762748 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:53.287729 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a42d2d79-b113-4e36-af35-bdc207762748 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:53.412360 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-3c6d8b3d-687e-4dac-862d-62a8117fd7ee tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:53.421800 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-3c6d8b3d-687e-4dac-862d-62a8117fd7ee tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1261 microversion: 2.1 time: 0.200636 Oct 27 17:34:53.423846 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 295/556] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:53 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1261 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:53.445415 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-e0b8e6a8-42a1-4143-810a-215d382d667e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:53.446689 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e0b8e6a8-42a1-4143-810a-215d382d667e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:53.455059 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e0b8e6a8-42a1-4143-810a-215d382d667e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:53.456169 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e0b8e6a8-42a1-4143-810a-215d382d667e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:53.456839 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e0b8e6a8-42a1-4143-810a-215d382d667e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:53.456979 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a42d2d79-b113-4e36-af35-bdc207762748 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:53.458185 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e0b8e6a8-42a1-4143-810a-215d382d667e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:53.458793 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e0b8e6a8-42a1-4143-810a-215d382d667e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:53.459363 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e0b8e6a8-42a1-4143-810a-215d382d667e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:53.466464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a42d2d79-b113-4e36-af35-bdc207762748 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:53.468198 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a42d2d79-b113-4e36-af35-bdc207762748 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:53.469581 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a42d2d79-b113-4e36-af35-bdc207762748 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1739 microversion: 2.20 time: 0.206996 Oct 27 17:34:53.473122 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 262/557] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:53 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:34:53.483932 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=100 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:34:53.605886 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e0b8e6a8-42a1-4143-810a-215d382d667e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:53.615364 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-e0b8e6a8-42a1-4143-810a-215d382d667e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1366 microversion: 2.1 time: 0.189777 Oct 27 17:34:53.616333 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 296/558] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:53 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:54.174661 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e3edcb7b-2a53-465b-a0a7-4ca9fa3bde1d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:54.175936 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e3edcb7b-2a53-465b-a0a7-4ca9fa3bde1d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:54.182427 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3edcb7b-2a53-465b-a0a7-4ca9fa3bde1d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:54.183112 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3edcb7b-2a53-465b-a0a7-4ca9fa3bde1d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:54.183763 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3edcb7b-2a53-465b-a0a7-4ca9fa3bde1d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:54.184665 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3edcb7b-2a53-465b-a0a7-4ca9fa3bde1d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:54.185227 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3edcb7b-2a53-465b-a0a7-4ca9fa3bde1d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:54.185717 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3edcb7b-2a53-465b-a0a7-4ca9fa3bde1d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:54.327288 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e3edcb7b-2a53-465b-a0a7-4ca9fa3bde1d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:54.341042 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e3edcb7b-2a53-465b-a0a7-4ca9fa3bde1d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1722 microversion: 2.1 time: 0.170828 Oct 27 17:34:54.342273 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 263/559] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:54 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:54.450651 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-58ab038e-2e86-4640-a9d7-e662dbc845cb tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:54.451239 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-58ab038e-2e86-4640-a9d7-e662dbc845cb tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:54.457785 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-58ab038e-2e86-4640-a9d7-e662dbc845cb tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:54.458288 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-58ab038e-2e86-4640-a9d7-e662dbc845cb tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:54.458753 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-58ab038e-2e86-4640-a9d7-e662dbc845cb tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:54.459485 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-58ab038e-2e86-4640-a9d7-e662dbc845cb tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:54.459958 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-58ab038e-2e86-4640-a9d7-e662dbc845cb tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:54.460382 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-58ab038e-2e86-4640-a9d7-e662dbc845cb tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:54.496988 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ddaf01f1-e683-4ca1-9497-180e8543fe9c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:54.497747 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ddaf01f1-e683-4ca1-9497-180e8543fe9c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:54.504624 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ddaf01f1-e683-4ca1-9497-180e8543fe9c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:54.504931 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ddaf01f1-e683-4ca1-9497-180e8543fe9c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:54.505394 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ddaf01f1-e683-4ca1-9497-180e8543fe9c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:54.506093 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ddaf01f1-e683-4ca1-9497-180e8543fe9c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:54.506545 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ddaf01f1-e683-4ca1-9497-180e8543fe9c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:54.506966 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ddaf01f1-e683-4ca1-9497-180e8543fe9c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:54.610916 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-58ab038e-2e86-4640-a9d7-e662dbc845cb tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:54.620138 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-58ab038e-2e86-4640-a9d7-e662dbc845cb tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1261 microversion: 2.1 time: 0.173394 Oct 27 17:34:54.620825 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 297/560] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:54 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:54.643243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d636dde8-aad3-4e1b-95d9-705bac3e6af1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:54.643902 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d636dde8-aad3-4e1b-95d9-705bac3e6af1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:54.650191 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d636dde8-aad3-4e1b-95d9-705bac3e6af1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:54.650681 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d636dde8-aad3-4e1b-95d9-705bac3e6af1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:54.651119 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d636dde8-aad3-4e1b-95d9-705bac3e6af1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:54.651856 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d636dde8-aad3-4e1b-95d9-705bac3e6af1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:54.652589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d636dde8-aad3-4e1b-95d9-705bac3e6af1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:54.653018 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d636dde8-aad3-4e1b-95d9-705bac3e6af1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:54.678568 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ddaf01f1-e683-4ca1-9497-180e8543fe9c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:54.687351 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ddaf01f1-e683-4ca1-9497-180e8543fe9c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:54.689195 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ddaf01f1-e683-4ca1-9497-180e8543fe9c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:54.690349 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ddaf01f1-e683-4ca1-9497-180e8543fe9c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1739 microversion: 2.20 time: 0.197089 Oct 27 17:34:54.691275 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 264/561] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:54 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:34:54.793703 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d636dde8-aad3-4e1b-95d9-705bac3e6af1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:54.802180 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d636dde8-aad3-4e1b-95d9-705bac3e6af1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1557 microversion: 2.1 time: 0.163157 Oct 27 17:34:54.802749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 298/562] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:54 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:34:54.824749 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d311c73e-855b-427f-aea8-d949ed5fc414 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:54.825242 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d311c73e-855b-427f-aea8-d949ed5fc414 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:54.831358 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d311c73e-855b-427f-aea8-d949ed5fc414 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:54.832127 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d311c73e-855b-427f-aea8-d949ed5fc414 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:54.832566 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d311c73e-855b-427f-aea8-d949ed5fc414 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:54.833464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d311c73e-855b-427f-aea8-d949ed5fc414 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:54.833974 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d311c73e-855b-427f-aea8-d949ed5fc414 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:54.834404 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d311c73e-855b-427f-aea8-d949ed5fc414 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:54.917447 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d311c73e-855b-427f-aea8-d949ed5fc414 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096531 Oct 27 17:34:54.918786 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 265/563] 10.222.0.36 () {58 vars in 1275 bytes} [Thu Oct 27 17:34:54 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:34:55.366418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-69d5eedf-2efc-48a3-8710-7bc32b9ace87 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:55.367046 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-69d5eedf-2efc-48a3-8710-7bc32b9ace87 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:55.374092 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-69d5eedf-2efc-48a3-8710-7bc32b9ace87 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:55.374762 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-69d5eedf-2efc-48a3-8710-7bc32b9ace87 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:55.375364 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-69d5eedf-2efc-48a3-8710-7bc32b9ace87 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:55.376714 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-69d5eedf-2efc-48a3-8710-7bc32b9ace87 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:55.377181 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-69d5eedf-2efc-48a3-8710-7bc32b9ace87 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:55.377860 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-69d5eedf-2efc-48a3-8710-7bc32b9ace87 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:55.532584 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-69d5eedf-2efc-48a3-8710-7bc32b9ace87 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:55.541306 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-69d5eedf-2efc-48a3-8710-7bc32b9ace87 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1722 microversion: 2.1 time: 0.179135 Oct 27 17:34:55.552264 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 299/564] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:55 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:55.645574 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f8563035-bf50-4d52-b003-7921e1727126 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:55.646931 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-f8563035-bf50-4d52-b003-7921e1727126 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:55.653740 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8563035-bf50-4d52-b003-7921e1727126 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:55.654215 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8563035-bf50-4d52-b003-7921e1727126 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:55.654857 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8563035-bf50-4d52-b003-7921e1727126 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:55.655555 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8563035-bf50-4d52-b003-7921e1727126 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:55.656029 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8563035-bf50-4d52-b003-7921e1727126 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:55.657182 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8563035-bf50-4d52-b003-7921e1727126 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:55.720692 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4200db04-e8c6-4c3a-9525-e17592249c4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:55.721329 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4200db04-e8c6-4c3a-9525-e17592249c4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:55.728119 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4200db04-e8c6-4c3a-9525-e17592249c4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:55.729298 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4200db04-e8c6-4c3a-9525-e17592249c4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:55.729787 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4200db04-e8c6-4c3a-9525-e17592249c4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:55.730773 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4200db04-e8c6-4c3a-9525-e17592249c4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:55.731440 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4200db04-e8c6-4c3a-9525-e17592249c4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:55.732084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4200db04-e8c6-4c3a-9525-e17592249c4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:55.890042 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f8563035-bf50-4d52-b003-7921e1727126 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:55.899378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4200db04-e8c6-4c3a-9525-e17592249c4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:55.900109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f8563035-bf50-4d52-b003-7921e1727126 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1261 microversion: 2.1 time: 0.258834 Oct 27 17:34:55.900889 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 266/565] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:55 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1261 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:55.911780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4200db04-e8c6-4c3a-9525-e17592249c4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:55.913709 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4200db04-e8c6-4c3a-9525-e17592249c4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:55.915847 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4200db04-e8c6-4c3a-9525-e17592249c4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1739 microversion: 2.20 time: 0.203476 Oct 27 17:34:55.917348 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 300/566] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:55 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:34:56.412652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-0bdfe0ff-3108-4280-896a-8aec97d68fca req-943d0f09-d247-43e3-81c8-5e7383da8b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50b532a6-30c9-44d5-b680-2e6bc6b2c41a", "tag": "e8441a6d-549a-4734-aaa6-21d018ed2a33"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:56.424318 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-0bdfe0ff-3108-4280-896a-8aec97d68fca req-943d0f09-d247-43e3-81c8-5e7383da8b61 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:56.425156 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-0bdfe0ff-3108-4280-896a-8aec97d68fca req-943d0f09-d247-43e3-81c8-5e7383da8b61 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:56.425802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-0bdfe0ff-3108-4280-896a-8aec97d68fca req-943d0f09-d247-43e3-81c8-5e7383da8b61 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:56.441237 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-0bdfe0ff-3108-4280-896a-8aec97d68fca req-943d0f09-d247-43e3-81c8-5e7383da8b61 service nova] Creating event network-changed:e8441a6d-549a-4734-aaa6-21d018ed2a33 for instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a on hv-cinder-86283 Oct 27 17:34:56.447618 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-0bdfe0ff-3108-4280-896a-8aec97d68fca req-943d0f09-d247-43e3-81c8-5e7383da8b61 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039842 Oct 27 17:34:56.449025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 267/567] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:34:56.565965 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-e74cecf6-9bd9-4ee4-a88e-48ccb5de144f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:56.567186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e74cecf6-9bd9-4ee4-a88e-48ccb5de144f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:56.574071 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e74cecf6-9bd9-4ee4-a88e-48ccb5de144f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:56.593553 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e74cecf6-9bd9-4ee4-a88e-48ccb5de144f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:56.595214 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e74cecf6-9bd9-4ee4-a88e-48ccb5de144f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:56.596237 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e74cecf6-9bd9-4ee4-a88e-48ccb5de144f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:56.596713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e74cecf6-9bd9-4ee4-a88e-48ccb5de144f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:56.597136 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e74cecf6-9bd9-4ee4-a88e-48ccb5de144f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:56.757249 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e74cecf6-9bd9-4ee4-a88e-48ccb5de144f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:56.769557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-e74cecf6-9bd9-4ee4-a88e-48ccb5de144f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1722 microversion: 2.1 time: 0.207331 Oct 27 17:34:56.770733 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 301/568] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:56 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:56.928818 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-92d65193-8fc4-4f61-8788-dff21038d4d7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:56.931864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-92d65193-8fc4-4f61-8788-dff21038d4d7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:56.948540 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4dcc0f98-0b90-4fb9-9369-8851457b8f63 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:56.949723 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4dcc0f98-0b90-4fb9-9369-8851457b8f63 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:56.967477 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dcc0f98-0b90-4fb9-9369-8851457b8f63 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:56.969587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-92d65193-8fc4-4f61-8788-dff21038d4d7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:56.970374 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dcc0f98-0b90-4fb9-9369-8851457b8f63 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:56.971065 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-92d65193-8fc4-4f61-8788-dff21038d4d7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:56.971851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dcc0f98-0b90-4fb9-9369-8851457b8f63 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:56.972511 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-92d65193-8fc4-4f61-8788-dff21038d4d7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:56.973442 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dcc0f98-0b90-4fb9-9369-8851457b8f63 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:56.976126 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dcc0f98-0b90-4fb9-9369-8851457b8f63 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:56.976959 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-92d65193-8fc4-4f61-8788-dff21038d4d7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:56.977693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-92d65193-8fc4-4f61-8788-dff21038d4d7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:56.978798 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dcc0f98-0b90-4fb9-9369-8851457b8f63 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:56.979646 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-92d65193-8fc4-4f61-8788-dff21038d4d7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:57.223832 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4dcc0f98-0b90-4fb9-9369-8851457b8f63 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:57.239506 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4dcc0f98-0b90-4fb9-9369-8851457b8f63 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:57.243193 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4dcc0f98-0b90-4fb9-9369-8851457b8f63 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:57.246137 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4dcc0f98-0b90-4fb9-9369-8851457b8f63 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1739 microversion: 2.20 time: 0.302023 Oct 27 17:34:57.257591 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 302/569] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:56 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:57.389256 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-92d65193-8fc4-4f61-8788-dff21038d4d7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:57.407896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-92d65193-8fc4-4f61-8788-dff21038d4d7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1261 microversion: 2.1 time: 0.488844 Oct 27 17:34:57.408733 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 268/570] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:56 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1261 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:57.796101 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-aed29f0f-136b-48b0-960e-e02385e798f3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:57.798582 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-aed29f0f-136b-48b0-960e-e02385e798f3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:57.806451 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aed29f0f-136b-48b0-960e-e02385e798f3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:57.807276 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aed29f0f-136b-48b0-960e-e02385e798f3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:57.807905 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aed29f0f-136b-48b0-960e-e02385e798f3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:57.808786 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aed29f0f-136b-48b0-960e-e02385e798f3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:57.809240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aed29f0f-136b-48b0-960e-e02385e798f3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:57.809657 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aed29f0f-136b-48b0-960e-e02385e798f3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:57.966901 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-aed29f0f-136b-48b0-960e-e02385e798f3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:57.976727 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-aed29f0f-136b-48b0-960e-e02385e798f3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1722 microversion: 2.1 time: 0.184466 Oct 27 17:34:57.977401 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 303/571] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:57 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:58.281811 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-fdd5b3c4-fbd5-4d63-a514-c95757373870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:58.282563 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-fdd5b3c4-fbd5-4d63-a514-c95757373870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:58.293978 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fdd5b3c4-fbd5-4d63-a514-c95757373870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:58.295865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fdd5b3c4-fbd5-4d63-a514-c95757373870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:58.297153 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fdd5b3c4-fbd5-4d63-a514-c95757373870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:58.298377 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fdd5b3c4-fbd5-4d63-a514-c95757373870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:58.302032 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fdd5b3c4-fbd5-4d63-a514-c95757373870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:58.303450 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fdd5b3c4-fbd5-4d63-a514-c95757373870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:58.435406 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-182106f1-bf63-4cd8-a33f-8924e9302539 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:58.436522 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-182106f1-bf63-4cd8-a33f-8924e9302539 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:58.446043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-182106f1-bf63-4cd8-a33f-8924e9302539 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:58.447362 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-182106f1-bf63-4cd8-a33f-8924e9302539 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:58.447845 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-182106f1-bf63-4cd8-a33f-8924e9302539 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:58.448575 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-182106f1-bf63-4cd8-a33f-8924e9302539 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:58.449037 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-182106f1-bf63-4cd8-a33f-8924e9302539 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:58.449465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-182106f1-bf63-4cd8-a33f-8924e9302539 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:58.550263 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-fdd5b3c4-fbd5-4d63-a514-c95757373870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:58.566659 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-fdd5b3c4-fbd5-4d63-a514-c95757373870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:58.568161 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-fdd5b3c4-fbd5-4d63-a514-c95757373870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:58.569373 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-fdd5b3c4-fbd5-4d63-a514-c95757373870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1739 microversion: 2.20 time: 0.292418 Oct 27 17:34:58.569934 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 269/572] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:58 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:34:58.704701 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-182106f1-bf63-4cd8-a33f-8924e9302539 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:58.714119 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-182106f1-bf63-4cd8-a33f-8924e9302539 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1261 microversion: 2.1 time: 0.284227 Oct 27 17:34:58.715108 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 304/573] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:58 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1261 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:59.001445 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e3ec0493-4a6e-45b1-b029-f762bf8de110 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:59.002050 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e3ec0493-4a6e-45b1-b029-f762bf8de110 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:59.008126 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3ec0493-4a6e-45b1-b029-f762bf8de110 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:59.008602 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3ec0493-4a6e-45b1-b029-f762bf8de110 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:59.009211 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3ec0493-4a6e-45b1-b029-f762bf8de110 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:59.009893 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3ec0493-4a6e-45b1-b029-f762bf8de110 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:59.010339 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3ec0493-4a6e-45b1-b029-f762bf8de110 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:59.010756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3ec0493-4a6e-45b1-b029-f762bf8de110 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:59.158921 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e3ec0493-4a6e-45b1-b029-f762bf8de110 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:59.175090 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e3ec0493-4a6e-45b1-b029-f762bf8de110 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1699 microversion: 2.1 time: 0.177969 Oct 27 17:34:59.176800 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 270/574] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:58 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1699 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:59.201798 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-75463d60-ff8f-4a04-9e8c-c5f688e3f964 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:34:59.209509 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75463d60-ff8f-4a04-9e8c-c5f688e3f964 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:59.210320 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75463d60-ff8f-4a04-9e8c-c5f688e3f964 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:59.210977 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75463d60-ff8f-4a04-9e8c-c5f688e3f964 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:59.275070 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-75463d60-ff8f-4a04-9e8c-c5f688e3f964 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Going to try to start instance {{(pid=119047) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 17:34:59.326333 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-75463d60-ff8f-4a04-9e8c-c5f688e3f964 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "POST /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/action" status: 202 len: 0 microversion: 2.1 time: 0.127661 Oct 27 17:34:59.327406 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 305/575] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Oct 27 17:34:59 2022] POST /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:34:59.348580 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2cd1a494-769e-4750-b41a-744fd464012c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:59.352667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2cd1a494-769e-4750-b41a-744fd464012c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:59.381630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2cd1a494-769e-4750-b41a-744fd464012c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:59.382126 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2cd1a494-769e-4750-b41a-744fd464012c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:59.382562 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2cd1a494-769e-4750-b41a-744fd464012c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:59.383277 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2cd1a494-769e-4750-b41a-744fd464012c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:59.383770 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2cd1a494-769e-4750-b41a-744fd464012c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:59.384288 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2cd1a494-769e-4750-b41a-744fd464012c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:59.588769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2cd1a494-769e-4750-b41a-744fd464012c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:59.599093 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2cd1a494-769e-4750-b41a-744fd464012c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1708 microversion: 2.1 time: 0.263706 Oct 27 17:34:59.599333 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-97ba2b46-172b-4914-bbe1-aa4c5af3adc1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:59.600266 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-97ba2b46-172b-4914-bbe1-aa4c5af3adc1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:59.610222 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97ba2b46-172b-4914-bbe1-aa4c5af3adc1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:59.611572 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97ba2b46-172b-4914-bbe1-aa4c5af3adc1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:59.612423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97ba2b46-172b-4914-bbe1-aa4c5af3adc1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:59.612989 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 271/576] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:59 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1708 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:34:59.614136 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97ba2b46-172b-4914-bbe1-aa4c5af3adc1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:59.614846 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97ba2b46-172b-4914-bbe1-aa4c5af3adc1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:59.616491 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97ba2b46-172b-4914-bbe1-aa4c5af3adc1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:59.737567 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-c2065884-6c4e-45c8-8eab-c6510dcfff4e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:34:59.738710 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c2065884-6c4e-45c8-8eab-c6510dcfff4e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:34:59.749874 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c2065884-6c4e-45c8-8eab-c6510dcfff4e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:59.750718 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c2065884-6c4e-45c8-8eab-c6510dcfff4e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:59.751333 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c2065884-6c4e-45c8-8eab-c6510dcfff4e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:59.752346 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c2065884-6c4e-45c8-8eab-c6510dcfff4e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:34:59.753001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c2065884-6c4e-45c8-8eab-c6510dcfff4e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:34:59.753596 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c2065884-6c4e-45c8-8eab-c6510dcfff4e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:34:59.801809 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-97ba2b46-172b-4914-bbe1-aa4c5af3adc1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:59.810543 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-97ba2b46-172b-4914-bbe1-aa4c5af3adc1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:59.812333 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-97ba2b46-172b-4914-bbe1-aa4c5af3adc1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:34:59.816346 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-97ba2b46-172b-4914-bbe1-aa4c5af3adc1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1739 microversion: 2.20 time: 0.221429 Oct 27 17:34:59.827769 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 306/577] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:34:59 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:35:00.073948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-c2065884-6c4e-45c8-8eab-c6510dcfff4e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:00.082600 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-c2065884-6c4e-45c8-8eab-c6510dcfff4e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1261 microversion: 2.1 time: 0.348957 Oct 27 17:35:00.083293 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 272/578] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:34:59 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1261 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:35:00.447147 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-92e9f0c4-c3d3-48f2-9178-4d53444a497c req-7b6f4d6b-ebb0-4b62-8f97-e003cdc0a893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a883d9-7208-49ab-9775-557bba9f7efd", "name": "network-vif-plugged", "status": "completed", "tag": "469bd0cf-71f5-4704-9199-a07d128929ab"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:35:00.459475 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-92e9f0c4-c3d3-48f2-9178-4d53444a497c req-7b6f4d6b-ebb0-4b62-8f97-e003cdc0a893 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:00.460057 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-92e9f0c4-c3d3-48f2-9178-4d53444a497c req-7b6f4d6b-ebb0-4b62-8f97-e003cdc0a893 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:00.460544 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-92e9f0c4-c3d3-48f2-9178-4d53444a497c req-7b6f4d6b-ebb0-4b62-8f97-e003cdc0a893 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:00.476989 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-92e9f0c4-c3d3-48f2-9178-4d53444a497c req-7b6f4d6b-ebb0-4b62-8f97-e003cdc0a893 service nova] Creating event network-vif-plugged:469bd0cf-71f5-4704-9199-a07d128929ab for instance 26a883d9-7208-49ab-9775-557bba9f7efd on hv-cinder-86283 Oct 27 17:35:00.482530 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-92e9f0c4-c3d3-48f2-9178-4d53444a497c req-7b6f4d6b-ebb0-4b62-8f97-e003cdc0a893 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039137 Oct 27 17:35:00.483681 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 307/579] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:35:00.624747 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-bcd9004a-2aac-4aba-a9c0-853e5497ea3d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:00.626198 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-bcd9004a-2aac-4aba-a9c0-853e5497ea3d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:00.633497 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bcd9004a-2aac-4aba-a9c0-853e5497ea3d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:00.634331 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bcd9004a-2aac-4aba-a9c0-853e5497ea3d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:00.634842 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bcd9004a-2aac-4aba-a9c0-853e5497ea3d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:00.635563 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bcd9004a-2aac-4aba-a9c0-853e5497ea3d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:00.636050 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bcd9004a-2aac-4aba-a9c0-853e5497ea3d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:00.636632 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bcd9004a-2aac-4aba-a9c0-853e5497ea3d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:00.826377 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-bcd9004a-2aac-4aba-a9c0-853e5497ea3d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:00.836397 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-bcd9004a-2aac-4aba-a9c0-853e5497ea3d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1708 microversion: 2.1 time: 0.215582 Oct 27 17:35:00.837209 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 273/580] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:00 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1708 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:35:00.848730 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1fbdf66a-e595-4fb5-86b5-5fe62da72ee6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:00.849565 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-1fbdf66a-e595-4fb5-86b5-5fe62da72ee6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:00.857472 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1fbdf66a-e595-4fb5-86b5-5fe62da72ee6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:00.858061 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1fbdf66a-e595-4fb5-86b5-5fe62da72ee6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:00.858571 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1fbdf66a-e595-4fb5-86b5-5fe62da72ee6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:00.859947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1fbdf66a-e595-4fb5-86b5-5fe62da72ee6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:00.860611 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1fbdf66a-e595-4fb5-86b5-5fe62da72ee6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:00.861255 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1fbdf66a-e595-4fb5-86b5-5fe62da72ee6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:01.053291 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1fbdf66a-e595-4fb5-86b5-5fe62da72ee6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:01.062605 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1fbdf66a-e595-4fb5-86b5-5fe62da72ee6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:01.065718 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1fbdf66a-e595-4fb5-86b5-5fe62da72ee6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:01.067063 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1fbdf66a-e595-4fb5-86b5-5fe62da72ee6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1739 microversion: 2.20 time: 0.223228 Oct 27 17:35:01.068439 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 308/581] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:00 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:01.105506 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-977c43d7-16f8-41ee-a9fa-ecd9aa3cbcde tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:01.106117 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-977c43d7-16f8-41ee-a9fa-ecd9aa3cbcde tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:01.112104 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-977c43d7-16f8-41ee-a9fa-ecd9aa3cbcde tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:01.112583 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-977c43d7-16f8-41ee-a9fa-ecd9aa3cbcde tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:01.113017 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-977c43d7-16f8-41ee-a9fa-ecd9aa3cbcde tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:01.113696 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-977c43d7-16f8-41ee-a9fa-ecd9aa3cbcde tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:01.114145 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-977c43d7-16f8-41ee-a9fa-ecd9aa3cbcde tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:01.114563 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-977c43d7-16f8-41ee-a9fa-ecd9aa3cbcde tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:01.249121 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-977c43d7-16f8-41ee-a9fa-ecd9aa3cbcde tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:01.257428 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-977c43d7-16f8-41ee-a9fa-ecd9aa3cbcde tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1261 microversion: 2.1 time: 0.155915 Oct 27 17:35:01.258733 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 274/582] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:01 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:01.866624 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4234968c-7dd1-46e3-aefa-458dfa00976b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:01.868226 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4234968c-7dd1-46e3-aefa-458dfa00976b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:01.877125 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4234968c-7dd1-46e3-aefa-458dfa00976b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:01.877616 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4234968c-7dd1-46e3-aefa-458dfa00976b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:01.878049 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4234968c-7dd1-46e3-aefa-458dfa00976b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:01.879008 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4234968c-7dd1-46e3-aefa-458dfa00976b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:01.879673 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4234968c-7dd1-46e3-aefa-458dfa00976b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:01.880443 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4234968c-7dd1-46e3-aefa-458dfa00976b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:02.031077 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4234968c-7dd1-46e3-aefa-458dfa00976b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:02.040727 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4234968c-7dd1-46e3-aefa-458dfa00976b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1712 microversion: 2.1 time: 0.180189 Oct 27 17:35:02.041322 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 309/583] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:01 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1712 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:02.093686 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-959b0e93-f511-4e44-a181-22df62c81593 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:02.094296 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-959b0e93-f511-4e44-a181-22df62c81593 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:02.101945 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-959b0e93-f511-4e44-a181-22df62c81593 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:02.102442 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-959b0e93-f511-4e44-a181-22df62c81593 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:02.102880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-959b0e93-f511-4e44-a181-22df62c81593 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:02.103924 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-959b0e93-f511-4e44-a181-22df62c81593 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:02.104371 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-959b0e93-f511-4e44-a181-22df62c81593 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:02.104779 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-959b0e93-f511-4e44-a181-22df62c81593 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:02.280011 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-959b0e93-f511-4e44-a181-22df62c81593 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:02.281457 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4dfec25e-160a-4823-b66d-499a435e66c9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:02.282464 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4dfec25e-160a-4823-b66d-499a435e66c9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:02.288447 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dfec25e-160a-4823-b66d-499a435e66c9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:02.288940 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dfec25e-160a-4823-b66d-499a435e66c9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:02.289130 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-959b0e93-f511-4e44-a181-22df62c81593 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:02.289383 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dfec25e-160a-4823-b66d-499a435e66c9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:02.290183 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dfec25e-160a-4823-b66d-499a435e66c9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:02.290524 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dfec25e-160a-4823-b66d-499a435e66c9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:02.290953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dfec25e-160a-4823-b66d-499a435e66c9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:02.291061 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-959b0e93-f511-4e44-a181-22df62c81593 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:02.292142 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-959b0e93-f511-4e44-a181-22df62c81593 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1739 microversion: 2.20 time: 0.202437 Oct 27 17:35:02.294067 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 275/584] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:02 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:02.439118 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4dfec25e-160a-4823-b66d-499a435e66c9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:02.447293 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4dfec25e-160a-4823-b66d-499a435e66c9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1261 microversion: 2.1 time: 0.170256 Oct 27 17:35:02.459787 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 310/585] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:02 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:35:03.324006 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-385b52a0-e1a2-4680-8d03-1a0b354ae57c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:03.324632 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-385b52a0-e1a2-4680-8d03-1a0b354ae57c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:03.332672 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-385b52a0-e1a2-4680-8d03-1a0b354ae57c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:03.333144 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-385b52a0-e1a2-4680-8d03-1a0b354ae57c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:03.333570 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-385b52a0-e1a2-4680-8d03-1a0b354ae57c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:03.334246 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-385b52a0-e1a2-4680-8d03-1a0b354ae57c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:03.334687 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-385b52a0-e1a2-4680-8d03-1a0b354ae57c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:03.335103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-385b52a0-e1a2-4680-8d03-1a0b354ae57c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:03.459962 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-385b52a0-e1a2-4680-8d03-1a0b354ae57c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:03.467875 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-385b52a0-e1a2-4680-8d03-1a0b354ae57c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:03.469922 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-385b52a0-e1a2-4680-8d03-1a0b354ae57c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:03.471067 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-385b52a0-e1a2-4680-8d03-1a0b354ae57c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1739 microversion: 2.20 time: 0.150969 Oct 27 17:35:03.471614 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 276/586] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:03 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:03.473532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-9835c136-8a5a-4f9a-9a55-2c85929f18db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:03.474144 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-9835c136-8a5a-4f9a-9a55-2c85929f18db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:03.480957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9835c136-8a5a-4f9a-9a55-2c85929f18db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:03.481436 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9835c136-8a5a-4f9a-9a55-2c85929f18db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:03.481872 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9835c136-8a5a-4f9a-9a55-2c85929f18db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:03.482552 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9835c136-8a5a-4f9a-9a55-2c85929f18db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:03.483002 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9835c136-8a5a-4f9a-9a55-2c85929f18db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:03.483421 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9835c136-8a5a-4f9a-9a55-2c85929f18db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:03.619524 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9835c136-8a5a-4f9a-9a55-2c85929f18db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:03.627682 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-9835c136-8a5a-4f9a-9a55-2c85929f18db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1261 microversion: 2.1 time: 0.158068 Oct 27 17:35:03.628263 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 311/587] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:03 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:35:04.495612 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9f2aad35-d1db-4aa3-b107-00b5b23d1870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:04.496247 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9f2aad35-d1db-4aa3-b107-00b5b23d1870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:04.502608 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f2aad35-d1db-4aa3-b107-00b5b23d1870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:04.503081 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f2aad35-d1db-4aa3-b107-00b5b23d1870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:04.503505 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f2aad35-d1db-4aa3-b107-00b5b23d1870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:04.504212 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f2aad35-d1db-4aa3-b107-00b5b23d1870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:04.504654 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f2aad35-d1db-4aa3-b107-00b5b23d1870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:04.505068 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f2aad35-d1db-4aa3-b107-00b5b23d1870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:04.632253 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9f2aad35-d1db-4aa3-b107-00b5b23d1870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:04.640181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9f2aad35-d1db-4aa3-b107-00b5b23d1870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:04.641608 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9f2aad35-d1db-4aa3-b107-00b5b23d1870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:04.642741 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9f2aad35-d1db-4aa3-b107-00b5b23d1870 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1721 microversion: 2.20 time: 0.151045 Oct 27 17:35:04.643297 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 277/588] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:04 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:04.650374 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-01b678cb-80e3-4a13-8816-884a2bef009c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:04.650929 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-01b678cb-80e3-4a13-8816-884a2bef009c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:04.657916 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01b678cb-80e3-4a13-8816-884a2bef009c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:04.658414 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01b678cb-80e3-4a13-8816-884a2bef009c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:04.658849 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01b678cb-80e3-4a13-8816-884a2bef009c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:04.659535 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01b678cb-80e3-4a13-8816-884a2bef009c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:04.660012 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01b678cb-80e3-4a13-8816-884a2bef009c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:04.660463 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01b678cb-80e3-4a13-8816-884a2bef009c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:04.788427 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-01b678cb-80e3-4a13-8816-884a2bef009c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:04.790708 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:35:04.797348 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-01b678cb-80e3-4a13-8816-884a2bef009c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1445 microversion: 2.1 time: 0.150968 Oct 27 17:35:04.797912 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 312/589] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:04 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1445 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:04.819771 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-dbd0e248-f9fc-4884-bccc-20bbfb239754 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:04.820372 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-dbd0e248-f9fc-4884-bccc-20bbfb239754 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:04.826156 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dbd0e248-f9fc-4884-bccc-20bbfb239754 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:04.826625 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dbd0e248-f9fc-4884-bccc-20bbfb239754 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:04.827050 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dbd0e248-f9fc-4884-bccc-20bbfb239754 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:04.828250 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dbd0e248-f9fc-4884-bccc-20bbfb239754 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:04.828696 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dbd0e248-f9fc-4884-bccc-20bbfb239754 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:04.829108 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dbd0e248-f9fc-4884-bccc-20bbfb239754 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:04.960315 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-dbd0e248-f9fc-4884-bccc-20bbfb239754 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:04.968049 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-dbd0e248-f9fc-4884-bccc-20bbfb239754 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1445 microversion: 2.1 time: 0.152001 Oct 27 17:35:04.969242 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 278/590] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:04 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:05.669455 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4a0d4bea-bb2d-4845-847b-a694d52728c0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:05.670263 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4a0d4bea-bb2d-4845-847b-a694d52728c0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:05.678280 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4a0d4bea-bb2d-4845-847b-a694d52728c0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:05.678928 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4a0d4bea-bb2d-4845-847b-a694d52728c0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:05.679361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4a0d4bea-bb2d-4845-847b-a694d52728c0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:05.680083 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4a0d4bea-bb2d-4845-847b-a694d52728c0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:05.680532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4a0d4bea-bb2d-4845-847b-a694d52728c0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:05.680947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4a0d4bea-bb2d-4845-847b-a694d52728c0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:05.884294 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4a0d4bea-bb2d-4845-847b-a694d52728c0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:05.892357 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4a0d4bea-bb2d-4845-847b-a694d52728c0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:05.893773 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4a0d4bea-bb2d-4845-847b-a694d52728c0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:05.894909 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4a0d4bea-bb2d-4845-847b-a694d52728c0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1721 microversion: 2.20 time: 0.230619 Oct 27 17:35:05.895455 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 313/591] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:05 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:06.722135 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-9058a097-2705-4e9f-8bd3-aad8fb98842b req-c92b7ac5-3209-43ca-85a6-5b6d5ccb1488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26a883d9-7208-49ab-9775-557bba9f7efd", "tag": "469bd0cf-71f5-4704-9199-a07d128929ab"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:35:06.732645 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-9058a097-2705-4e9f-8bd3-aad8fb98842b req-c92b7ac5-3209-43ca-85a6-5b6d5ccb1488 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:06.733123 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-9058a097-2705-4e9f-8bd3-aad8fb98842b req-c92b7ac5-3209-43ca-85a6-5b6d5ccb1488 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:06.733547 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-9058a097-2705-4e9f-8bd3-aad8fb98842b req-c92b7ac5-3209-43ca-85a6-5b6d5ccb1488 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:06.737480 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=100 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:35:06.746418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-9058a097-2705-4e9f-8bd3-aad8fb98842b req-c92b7ac5-3209-43ca-85a6-5b6d5ccb1488 service nova] Creating event network-changed:469bd0cf-71f5-4704-9199-a07d128929ab for instance 26a883d9-7208-49ab-9775-557bba9f7efd on hv-cinder-86283 Oct 27 17:35:06.752098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-9058a097-2705-4e9f-8bd3-aad8fb98842b req-c92b7ac5-3209-43ca-85a6-5b6d5ccb1488 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033575 Oct 27 17:35:06.752698 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 279/592] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:35:06.921037 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-7d6286e9-5501-452f-b7b4-30b3d5921fce tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:06.921577 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-7d6286e9-5501-452f-b7b4-30b3d5921fce tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:06.928095 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7d6286e9-5501-452f-b7b4-30b3d5921fce tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:06.928610 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7d6286e9-5501-452f-b7b4-30b3d5921fce tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:06.929046 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7d6286e9-5501-452f-b7b4-30b3d5921fce tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:06.929740 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7d6286e9-5501-452f-b7b4-30b3d5921fce tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:06.930188 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7d6286e9-5501-452f-b7b4-30b3d5921fce tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:06.930616 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7d6286e9-5501-452f-b7b4-30b3d5921fce tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:07.072886 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7d6286e9-5501-452f-b7b4-30b3d5921fce tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:07.081694 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7d6286e9-5501-452f-b7b4-30b3d5921fce tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:07.083381 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7d6286e9-5501-452f-b7b4-30b3d5921fce tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:07.084581 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-7d6286e9-5501-452f-b7b4-30b3d5921fce tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1721 microversion: 2.20 time: 0.167610 Oct 27 17:35:07.085139 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 314/593] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:06 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:08.115419 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-646ba8a8-ba42-42df-b34d-4c45ab95ba73 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:08.116149 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-646ba8a8-ba42-42df-b34d-4c45ab95ba73 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:08.122339 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-646ba8a8-ba42-42df-b34d-4c45ab95ba73 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:08.122815 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-646ba8a8-ba42-42df-b34d-4c45ab95ba73 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:08.123243 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-646ba8a8-ba42-42df-b34d-4c45ab95ba73 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:08.123955 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-646ba8a8-ba42-42df-b34d-4c45ab95ba73 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:08.124426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-646ba8a8-ba42-42df-b34d-4c45ab95ba73 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:08.124882 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-646ba8a8-ba42-42df-b34d-4c45ab95ba73 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:08.257141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-646ba8a8-ba42-42df-b34d-4c45ab95ba73 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:08.265198 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-646ba8a8-ba42-42df-b34d-4c45ab95ba73 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:08.266630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-646ba8a8-ba42-42df-b34d-4c45ab95ba73 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:08.267794 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-646ba8a8-ba42-42df-b34d-4c45ab95ba73 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1724 microversion: 2.20 time: 0.157348 Oct 27 17:35:08.268352 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 280/594] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:08 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:08.292928 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-adfa16bc-866f-4042-8f0b-a68cdf61d1b2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8aa7fb75-6804-4ba0-b287-1d645a8fe1b1"}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:35:08.295512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-adfa16bc-866f-4042-8f0b-a68cdf61d1b2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:08.302280 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-adfa16bc-866f-4042-8f0b-a68cdf61d1b2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:08.302797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-adfa16bc-866f-4042-8f0b-a68cdf61d1b2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:08.303312 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-adfa16bc-866f-4042-8f0b-a68cdf61d1b2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:08.304061 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-adfa16bc-866f-4042-8f0b-a68cdf61d1b2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:08.304518 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-adfa16bc-866f-4042-8f0b-a68cdf61d1b2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:08.304943 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-adfa16bc-866f-4042-8f0b-a68cdf61d1b2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:08.328856 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-9dd1f5e7-6f97-4cd2-98d0-0254fd60d40c req-0df43d29-4dd6-4638-996e-da912832273d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b27a822-4c22-45f0-872b-67e5f360f45e", "name": "network-vif-unplugged", "status": "completed", "tag": "8d525473-0013-4431-baf7-e343fbc1a2eb"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:35:08.339076 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-9dd1f5e7-6f97-4cd2-98d0-0254fd60d40c req-0df43d29-4dd6-4638-996e-da912832273d service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:08.339518 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-9dd1f5e7-6f97-4cd2-98d0-0254fd60d40c req-0df43d29-4dd6-4638-996e-da912832273d service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:08.339965 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-9dd1f5e7-6f97-4cd2-98d0-0254fd60d40c req-0df43d29-4dd6-4638-996e-da912832273d service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:08.354227 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-9dd1f5e7-6f97-4cd2-98d0-0254fd60d40c req-0df43d29-4dd6-4638-996e-da912832273d service nova] Creating event network-vif-unplugged:8d525473-0013-4431-baf7-e343fbc1a2eb for instance 2b27a822-4c22-45f0-872b-67e5f360f45e on hv-cinder-86283 Oct 27 17:35:08.359672 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-9dd1f5e7-6f97-4cd2-98d0-0254fd60d40c req-0df43d29-4dd6-4638-996e-da912832273d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034276 Oct 27 17:35:08.360301 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 281/595] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:35:08.588838 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-adfa16bc-866f-4042-8f0b-a68cdf61d1b2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "POST /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299855 Oct 27 17:35:08.589444 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 315/596] 10.222.0.36 () {62 vars in 1364 bytes} [Thu Oct 27 17:35:08 2022] POST /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:35:08.717477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6ea6a5d0-3b53-46b9-88de-6962a3f1c59b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:35:08.718167 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6ea6a5d0-3b53-46b9-88de-6962a3f1c59b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:08.724806 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6ea6a5d0-3b53-46b9-88de-6962a3f1c59b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:08.725282 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6ea6a5d0-3b53-46b9-88de-6962a3f1c59b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:08.725707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6ea6a5d0-3b53-46b9-88de-6962a3f1c59b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:08.726431 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6ea6a5d0-3b53-46b9-88de-6962a3f1c59b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:08.726827 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6ea6a5d0-3b53-46b9-88de-6962a3f1c59b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:08.727240 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6ea6a5d0-3b53-46b9-88de-6962a3f1c59b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:08.769948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6ea6a5d0-3b53-46b9-88de-6962a3f1c59b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119046) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 17:35:08.835083 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6ea6a5d0-3b53-46b9-88de-6962a3f1c59b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "POST /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/action" status: 202 len: 0 microversion: 2.20 time: 0.121737 Oct 27 17:35:08.835655 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 282/597] 10.222.0.36 () {62 vars in 1319 bytes} [Thu Oct 27 17:35:08 2022] POST /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 17:35:08.844688 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-527fe096-ade2-4ae1-a2db-ff9672638a50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:08.845324 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-527fe096-ade2-4ae1-a2db-ff9672638a50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:08.851846 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-527fe096-ade2-4ae1-a2db-ff9672638a50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:08.852331 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-527fe096-ade2-4ae1-a2db-ff9672638a50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:08.852764 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-527fe096-ade2-4ae1-a2db-ff9672638a50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:08.853704 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-527fe096-ade2-4ae1-a2db-ff9672638a50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:08.854160 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-527fe096-ade2-4ae1-a2db-ff9672638a50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:08.854582 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-527fe096-ade2-4ae1-a2db-ff9672638a50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:08.987510 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-527fe096-ade2-4ae1-a2db-ff9672638a50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:08.996268 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-527fe096-ade2-4ae1-a2db-ff9672638a50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:08.997722 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-527fe096-ade2-4ae1-a2db-ff9672638a50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:08.998885 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-527fe096-ade2-4ae1-a2db-ff9672638a50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1750 microversion: 2.20 time: 0.158934 Oct 27 17:35:08.999973 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 316/598] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:08 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:10.026455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a86c816c-46bf-4c08-9303-a87534f18ec9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:10.027060 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a86c816c-46bf-4c08-9303-a87534f18ec9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:10.033621 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a86c816c-46bf-4c08-9303-a87534f18ec9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:10.034100 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a86c816c-46bf-4c08-9303-a87534f18ec9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:10.034529 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a86c816c-46bf-4c08-9303-a87534f18ec9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:10.035215 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a86c816c-46bf-4c08-9303-a87534f18ec9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:10.035661 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a86c816c-46bf-4c08-9303-a87534f18ec9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:10.037475 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a86c816c-46bf-4c08-9303-a87534f18ec9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:10.164454 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a86c816c-46bf-4c08-9303-a87534f18ec9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:10.172982 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a86c816c-46bf-4c08-9303-a87534f18ec9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:10.174437 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a86c816c-46bf-4c08-9303-a87534f18ec9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:10.175591 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a86c816c-46bf-4c08-9303-a87534f18ec9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1752 microversion: 2.20 time: 0.153508 Oct 27 17:35:10.176194 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 283/599] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:10 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:11.201341 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2e290ab2-bd1a-4f51-b453-bfdc2f8db39f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:11.201951 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2e290ab2-bd1a-4f51-b453-bfdc2f8db39f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:11.208250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e290ab2-bd1a-4f51-b453-bfdc2f8db39f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:11.208721 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e290ab2-bd1a-4f51-b453-bfdc2f8db39f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:11.209147 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e290ab2-bd1a-4f51-b453-bfdc2f8db39f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:11.209823 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e290ab2-bd1a-4f51-b453-bfdc2f8db39f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:11.210264 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e290ab2-bd1a-4f51-b453-bfdc2f8db39f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:11.210748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e290ab2-bd1a-4f51-b453-bfdc2f8db39f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:11.336274 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2e290ab2-bd1a-4f51-b453-bfdc2f8db39f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:11.345387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2e290ab2-bd1a-4f51-b453-bfdc2f8db39f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:11.346843 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2e290ab2-bd1a-4f51-b453-bfdc2f8db39f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:11.348050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2e290ab2-bd1a-4f51-b453-bfdc2f8db39f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.150514 Oct 27 17:35:11.348608 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 317/600] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:11 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:12.374331 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6b88cb37-e763-45b5-9d21-84319cc5b0f7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:12.375450 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6b88cb37-e763-45b5-9d21-84319cc5b0f7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:12.382000 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b88cb37-e763-45b5-9d21-84319cc5b0f7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:12.382424 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b88cb37-e763-45b5-9d21-84319cc5b0f7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:12.382852 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b88cb37-e763-45b5-9d21-84319cc5b0f7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:12.383533 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b88cb37-e763-45b5-9d21-84319cc5b0f7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:12.384009 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b88cb37-e763-45b5-9d21-84319cc5b0f7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:12.384428 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6b88cb37-e763-45b5-9d21-84319cc5b0f7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:12.517632 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-6b88cb37-e763-45b5-9d21-84319cc5b0f7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:12.526195 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-6b88cb37-e763-45b5-9d21-84319cc5b0f7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:12.527620 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-6b88cb37-e763-45b5-9d21-84319cc5b0f7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:12.528824 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6b88cb37-e763-45b5-9d21-84319cc5b0f7 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.158390 Oct 27 17:35:12.529366 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 284/601] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:12 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:13.555154 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-7abd1eee-f221-4f34-971c-9d8de473282a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:13.555808 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-7abd1eee-f221-4f34-971c-9d8de473282a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:13.562924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7abd1eee-f221-4f34-971c-9d8de473282a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:13.563399 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7abd1eee-f221-4f34-971c-9d8de473282a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:13.563859 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7abd1eee-f221-4f34-971c-9d8de473282a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:13.564545 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7abd1eee-f221-4f34-971c-9d8de473282a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:13.564990 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7abd1eee-f221-4f34-971c-9d8de473282a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:13.565404 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7abd1eee-f221-4f34-971c-9d8de473282a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:13.921574 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7abd1eee-f221-4f34-971c-9d8de473282a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:13.930280 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7abd1eee-f221-4f34-971c-9d8de473282a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:13.931766 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7abd1eee-f221-4f34-971c-9d8de473282a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:13.932909 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-7abd1eee-f221-4f34-971c-9d8de473282a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.382189 Oct 27 17:35:13.933468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 318/602] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:13 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:14.960145 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4a06d080-ac6f-4605-94a1-bdba26d25942 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:14.960990 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4a06d080-ac6f-4605-94a1-bdba26d25942 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:14.967677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4a06d080-ac6f-4605-94a1-bdba26d25942 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:14.968272 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4a06d080-ac6f-4605-94a1-bdba26d25942 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:14.968780 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4a06d080-ac6f-4605-94a1-bdba26d25942 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:14.969553 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4a06d080-ac6f-4605-94a1-bdba26d25942 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:14.970075 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4a06d080-ac6f-4605-94a1-bdba26d25942 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:14.970574 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4a06d080-ac6f-4605-94a1-bdba26d25942 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:15.162643 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4a06d080-ac6f-4605-94a1-bdba26d25942 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:15.171232 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4a06d080-ac6f-4605-94a1-bdba26d25942 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:15.172766 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4a06d080-ac6f-4605-94a1-bdba26d25942 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:15.174214 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4a06d080-ac6f-4605-94a1-bdba26d25942 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.218075 Oct 27 17:35:15.174765 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 285/603] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:14 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:16.200898 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4149cfe9-c0d9-4eec-87cc-cfc935cddee4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:16.202899 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4149cfe9-c0d9-4eec-87cc-cfc935cddee4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:16.209613 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4149cfe9-c0d9-4eec-87cc-cfc935cddee4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:16.210163 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4149cfe9-c0d9-4eec-87cc-cfc935cddee4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:16.210726 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4149cfe9-c0d9-4eec-87cc-cfc935cddee4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:16.211770 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4149cfe9-c0d9-4eec-87cc-cfc935cddee4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:16.212372 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4149cfe9-c0d9-4eec-87cc-cfc935cddee4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:16.212930 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4149cfe9-c0d9-4eec-87cc-cfc935cddee4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:16.398690 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4149cfe9-c0d9-4eec-87cc-cfc935cddee4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:16.408385 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4149cfe9-c0d9-4eec-87cc-cfc935cddee4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:16.409725 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4149cfe9-c0d9-4eec-87cc-cfc935cddee4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:16.411009 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4149cfe9-c0d9-4eec-87cc-cfc935cddee4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.214377 Oct 27 17:35:16.424241 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 319/604] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:16 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:17.435406 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f5b4fd16-cc6f-4e13-8ab9-dea496f52b3a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:17.441340 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-f5b4fd16-cc6f-4e13-8ab9-dea496f52b3a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:17.448929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f5b4fd16-cc6f-4e13-8ab9-dea496f52b3a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:17.449439 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f5b4fd16-cc6f-4e13-8ab9-dea496f52b3a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:17.449876 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f5b4fd16-cc6f-4e13-8ab9-dea496f52b3a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:17.450635 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f5b4fd16-cc6f-4e13-8ab9-dea496f52b3a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:17.451089 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f5b4fd16-cc6f-4e13-8ab9-dea496f52b3a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:17.451511 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f5b4fd16-cc6f-4e13-8ab9-dea496f52b3a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:17.586784 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f5b4fd16-cc6f-4e13-8ab9-dea496f52b3a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:17.597582 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f5b4fd16-cc6f-4e13-8ab9-dea496f52b3a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:17.599154 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f5b4fd16-cc6f-4e13-8ab9-dea496f52b3a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:17.600486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f5b4fd16-cc6f-4e13-8ab9-dea496f52b3a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.168994 Oct 27 17:35:17.601174 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 286/605] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:17 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:18.626506 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4129214e-0c03-4be0-ba8e-0036e3f4e352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:18.627117 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4129214e-0c03-4be0-ba8e-0036e3f4e352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:18.633628 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4129214e-0c03-4be0-ba8e-0036e3f4e352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:18.634105 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4129214e-0c03-4be0-ba8e-0036e3f4e352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:18.634541 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4129214e-0c03-4be0-ba8e-0036e3f4e352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:18.635228 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4129214e-0c03-4be0-ba8e-0036e3f4e352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:18.635680 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4129214e-0c03-4be0-ba8e-0036e3f4e352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:18.636125 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4129214e-0c03-4be0-ba8e-0036e3f4e352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:18.770583 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4129214e-0c03-4be0-ba8e-0036e3f4e352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:18.779438 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4129214e-0c03-4be0-ba8e-0036e3f4e352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:18.781392 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4129214e-0c03-4be0-ba8e-0036e3f4e352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:18.782560 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4129214e-0c03-4be0-ba8e-0036e3f4e352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.160673 Oct 27 17:35:18.783112 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 320/606] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:18 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:19.808797 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-cb52d30e-0c0e-4624-ad47-73ada1895388 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:19.809362 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-cb52d30e-0c0e-4624-ad47-73ada1895388 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:19.811873 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:35:19.817081 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb52d30e-0c0e-4624-ad47-73ada1895388 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:19.817562 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb52d30e-0c0e-4624-ad47-73ada1895388 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:19.817991 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb52d30e-0c0e-4624-ad47-73ada1895388 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:19.818676 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb52d30e-0c0e-4624-ad47-73ada1895388 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:19.819124 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb52d30e-0c0e-4624-ad47-73ada1895388 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:19.819543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb52d30e-0c0e-4624-ad47-73ada1895388 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:19.961952 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-cb52d30e-0c0e-4624-ad47-73ada1895388 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:19.971366 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-cb52d30e-0c0e-4624-ad47-73ada1895388 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:19.972864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-cb52d30e-0c0e-4624-ad47-73ada1895388 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:19.973997 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-cb52d30e-0c0e-4624-ad47-73ada1895388 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.169186 Oct 27 17:35:19.985495 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 287/607] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:19 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:20.999967 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-dbd25b94-0585-4c08-89f7-a3644449d7aa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:21.000580 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-dbd25b94-0585-4c08-89f7-a3644449d7aa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:21.002916 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=60 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:35:21.008316 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dbd25b94-0585-4c08-89f7-a3644449d7aa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:21.008793 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dbd25b94-0585-4c08-89f7-a3644449d7aa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:21.009227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dbd25b94-0585-4c08-89f7-a3644449d7aa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:21.009914 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dbd25b94-0585-4c08-89f7-a3644449d7aa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:21.010362 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dbd25b94-0585-4c08-89f7-a3644449d7aa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:21.010784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dbd25b94-0585-4c08-89f7-a3644449d7aa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:21.142861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-dbd25b94-0585-4c08-89f7-a3644449d7aa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:21.152059 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-dbd25b94-0585-4c08-89f7-a3644449d7aa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:21.153847 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-dbd25b94-0585-4c08-89f7-a3644449d7aa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:21.155157 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-dbd25b94-0585-4c08-89f7-a3644449d7aa tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.159612 Oct 27 17:35:21.167221 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 321/608] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:20 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:22.180924 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a234f331-2b7f-4499-aa31-197d75ebaaa2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:22.181536 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a234f331-2b7f-4499-aa31-197d75ebaaa2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:22.188679 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a234f331-2b7f-4499-aa31-197d75ebaaa2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:22.189155 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a234f331-2b7f-4499-aa31-197d75ebaaa2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:22.189585 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a234f331-2b7f-4499-aa31-197d75ebaaa2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:22.190266 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a234f331-2b7f-4499-aa31-197d75ebaaa2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:22.190716 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a234f331-2b7f-4499-aa31-197d75ebaaa2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:22.191137 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a234f331-2b7f-4499-aa31-197d75ebaaa2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:22.330482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a234f331-2b7f-4499-aa31-197d75ebaaa2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:22.340116 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a234f331-2b7f-4499-aa31-197d75ebaaa2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:22.341824 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a234f331-2b7f-4499-aa31-197d75ebaaa2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:22.343111 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a234f331-2b7f-4499-aa31-197d75ebaaa2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.166161 Oct 27 17:35:22.355790 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 288/609] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:22 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:23.371520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8f497af0-1414-4e5a-b4b4-808b1bce7b2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:23.372160 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8f497af0-1414-4e5a-b4b4-808b1bce7b2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:23.379204 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8f497af0-1414-4e5a-b4b4-808b1bce7b2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:23.379739 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8f497af0-1414-4e5a-b4b4-808b1bce7b2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:23.380171 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8f497af0-1414-4e5a-b4b4-808b1bce7b2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:23.380894 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8f497af0-1414-4e5a-b4b4-808b1bce7b2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:23.381375 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8f497af0-1414-4e5a-b4b4-808b1bce7b2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:23.381798 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8f497af0-1414-4e5a-b4b4-808b1bce7b2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:23.515397 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8f497af0-1414-4e5a-b4b4-808b1bce7b2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:23.523966 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8f497af0-1414-4e5a-b4b4-808b1bce7b2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:23.525404 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8f497af0-1414-4e5a-b4b4-808b1bce7b2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:23.526576 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8f497af0-1414-4e5a-b4b4-808b1bce7b2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.160799 Oct 27 17:35:23.527127 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 322/610] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:23 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:24.551751 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-5f27c52b-bafc-4f02-9cad-f6a69cc0c239 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:24.552389 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-5f27c52b-bafc-4f02-9cad-f6a69cc0c239 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:24.558801 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5f27c52b-bafc-4f02-9cad-f6a69cc0c239 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:24.559276 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5f27c52b-bafc-4f02-9cad-f6a69cc0c239 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:24.559701 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5f27c52b-bafc-4f02-9cad-f6a69cc0c239 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:24.560454 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5f27c52b-bafc-4f02-9cad-f6a69cc0c239 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:24.560881 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5f27c52b-bafc-4f02-9cad-f6a69cc0c239 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:24.561296 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5f27c52b-bafc-4f02-9cad-f6a69cc0c239 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:24.692860 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5f27c52b-bafc-4f02-9cad-f6a69cc0c239 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:24.702447 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5f27c52b-bafc-4f02-9cad-f6a69cc0c239 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:24.703934 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5f27c52b-bafc-4f02-9cad-f6a69cc0c239 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:24.705105 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-5f27c52b-bafc-4f02-9cad-f6a69cc0c239 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.157434 Oct 27 17:35:24.705666 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 289/611] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:24 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:25.730564 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a8c3ca2c-a1f8-43b8-bc04-710e668b2cf2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:25.731480 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a8c3ca2c-a1f8-43b8-bc04-710e668b2cf2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:25.738808 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a8c3ca2c-a1f8-43b8-bc04-710e668b2cf2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:25.739296 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a8c3ca2c-a1f8-43b8-bc04-710e668b2cf2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:25.739755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a8c3ca2c-a1f8-43b8-bc04-710e668b2cf2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:25.740461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a8c3ca2c-a1f8-43b8-bc04-710e668b2cf2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:25.740915 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a8c3ca2c-a1f8-43b8-bc04-710e668b2cf2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:25.741370 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a8c3ca2c-a1f8-43b8-bc04-710e668b2cf2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:25.875140 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a8c3ca2c-a1f8-43b8-bc04-710e668b2cf2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:25.883671 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a8c3ca2c-a1f8-43b8-bc04-710e668b2cf2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:25.885121 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a8c3ca2c-a1f8-43b8-bc04-710e668b2cf2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:25.886264 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a8c3ca2c-a1f8-43b8-bc04-710e668b2cf2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.160192 Oct 27 17:35:25.886821 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 323/612] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:25 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:26.914222 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0bef6427-64ce-4e9b-91d4-9912e217d6c8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:26.914854 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-0bef6427-64ce-4e9b-91d4-9912e217d6c8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:26.921167 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0bef6427-64ce-4e9b-91d4-9912e217d6c8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:26.921648 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0bef6427-64ce-4e9b-91d4-9912e217d6c8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:26.922076 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0bef6427-64ce-4e9b-91d4-9912e217d6c8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:26.922762 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0bef6427-64ce-4e9b-91d4-9912e217d6c8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:26.923210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0bef6427-64ce-4e9b-91d4-9912e217d6c8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:26.923631 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0bef6427-64ce-4e9b-91d4-9912e217d6c8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:27.054227 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0bef6427-64ce-4e9b-91d4-9912e217d6c8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:27.063843 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0bef6427-64ce-4e9b-91d4-9912e217d6c8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:27.065293 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0bef6427-64ce-4e9b-91d4-9912e217d6c8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:27.066444 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0bef6427-64ce-4e9b-91d4-9912e217d6c8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.156241 Oct 27 17:35:27.067002 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 290/613] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:26 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:28.091833 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-7fe55581-7d7a-44aa-a464-23e2527cce69 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:28.092999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-7fe55581-7d7a-44aa-a464-23e2527cce69 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:28.099464 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7fe55581-7d7a-44aa-a464-23e2527cce69 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:28.099978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7fe55581-7d7a-44aa-a464-23e2527cce69 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:28.100413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7fe55581-7d7a-44aa-a464-23e2527cce69 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:28.101096 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7fe55581-7d7a-44aa-a464-23e2527cce69 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:28.101548 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7fe55581-7d7a-44aa-a464-23e2527cce69 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:28.102029 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7fe55581-7d7a-44aa-a464-23e2527cce69 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:28.225776 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7fe55581-7d7a-44aa-a464-23e2527cce69 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:28.234593 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7fe55581-7d7a-44aa-a464-23e2527cce69 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:28.236059 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7fe55581-7d7a-44aa-a464-23e2527cce69 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:28.237204 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-7fe55581-7d7a-44aa-a464-23e2527cce69 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.149329 Oct 27 17:35:28.237763 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 324/614] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:28 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:29.369009 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d9487572-9d8c-47b4-8bae-ccb81ce5bf18 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:29.369612 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d9487572-9d8c-47b4-8bae-ccb81ce5bf18 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:29.376083 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d9487572-9d8c-47b4-8bae-ccb81ce5bf18 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:29.376561 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d9487572-9d8c-47b4-8bae-ccb81ce5bf18 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:29.376986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d9487572-9d8c-47b4-8bae-ccb81ce5bf18 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:29.377659 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d9487572-9d8c-47b4-8bae-ccb81ce5bf18 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:29.378103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d9487572-9d8c-47b4-8bae-ccb81ce5bf18 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:29.378518 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d9487572-9d8c-47b4-8bae-ccb81ce5bf18 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:29.507737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d9487572-9d8c-47b4-8bae-ccb81ce5bf18 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:29.516159 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d9487572-9d8c-47b4-8bae-ccb81ce5bf18 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:29.517642 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d9487572-9d8c-47b4-8bae-ccb81ce5bf18 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:29.518727 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d9487572-9d8c-47b4-8bae-ccb81ce5bf18 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.259484 Oct 27 17:35:29.519273 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 291/615] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:29 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:30.543774 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-9f177f25-bffd-464e-955b-056e0827c8ad tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:30.545098 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-9f177f25-bffd-464e-955b-056e0827c8ad tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:30.552381 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f177f25-bffd-464e-955b-056e0827c8ad tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:30.553222 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f177f25-bffd-464e-955b-056e0827c8ad tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:30.553660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f177f25-bffd-464e-955b-056e0827c8ad tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:30.554354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f177f25-bffd-464e-955b-056e0827c8ad tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:30.554801 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f177f25-bffd-464e-955b-056e0827c8ad tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:30.555285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9f177f25-bffd-464e-955b-056e0827c8ad tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:30.563093 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-68e05b98-1c90-49e6-bbbe-2ef0139d66a3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:35:30.569650 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-68e05b98-1c90-49e6-bbbe-2ef0139d66a3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:30.577109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-68e05b98-1c90-49e6-bbbe-2ef0139d66a3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:30.577594 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-68e05b98-1c90-49e6-bbbe-2ef0139d66a3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:30.578023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-68e05b98-1c90-49e6-bbbe-2ef0139d66a3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:30.578756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-68e05b98-1c90-49e6-bbbe-2ef0139d66a3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:30.579169 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-68e05b98-1c90-49e6-bbbe-2ef0139d66a3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:30.579901 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-68e05b98-1c90-49e6-bbbe-2ef0139d66a3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:30.659490 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-68e05b98-1c90-49e6-bbbe-2ef0139d66a3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "POST /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/action" status: 202 len: 0 microversion: 2.1 time: 0.100022 Oct 27 17:35:30.660505 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 292/616] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Oct 27 17:35:30 2022] POST /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 17:35:30.668750 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-99bafc08-c069-4316-abda-3a1a7cb14a4e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:30.669497 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-99bafc08-c069-4316-abda-3a1a7cb14a4e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:30.675904 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-99bafc08-c069-4316-abda-3a1a7cb14a4e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:30.676392 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-99bafc08-c069-4316-abda-3a1a7cb14a4e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:30.676818 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-99bafc08-c069-4316-abda-3a1a7cb14a4e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:30.677577 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-99bafc08-c069-4316-abda-3a1a7cb14a4e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:30.678025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-99bafc08-c069-4316-abda-3a1a7cb14a4e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:30.678443 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-99bafc08-c069-4316-abda-3a1a7cb14a4e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:30.694487 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9f177f25-bffd-464e-955b-056e0827c8ad tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:30.703310 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9f177f25-bffd-464e-955b-056e0827c8ad tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:30.704913 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9f177f25-bffd-464e-955b-056e0827c8ad tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:30.706299 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-9f177f25-bffd-464e-955b-056e0827c8ad tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.166663 Oct 27 17:35:30.707394 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 325/617] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:30 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:30.836331 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-99bafc08-c069-4316-abda-3a1a7cb14a4e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:30.845124 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-99bafc08-c069-4316-abda-3a1a7cb14a4e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1750 microversion: 2.1 time: 0.180561 Oct 27 17:35:30.845682 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 293/618] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:30 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1750 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:35:31.732239 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-cbdcb5a2-1711-4415-853c-fd0ca7655185 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:31.733420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-cbdcb5a2-1711-4415-853c-fd0ca7655185 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:31.739937 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cbdcb5a2-1711-4415-853c-fd0ca7655185 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:31.740423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cbdcb5a2-1711-4415-853c-fd0ca7655185 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:31.740860 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cbdcb5a2-1711-4415-853c-fd0ca7655185 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:31.741558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cbdcb5a2-1711-4415-853c-fd0ca7655185 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:31.742012 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cbdcb5a2-1711-4415-853c-fd0ca7655185 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:31.742437 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cbdcb5a2-1711-4415-853c-fd0ca7655185 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:31.868284 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-cbdcb5a2-1711-4415-853c-fd0ca7655185 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:31.869177 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-aad25d2d-77f0-4ab1-a76f-22820c19fb00 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:31.869780 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-aad25d2d-77f0-4ab1-a76f-22820c19fb00 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:31.870442 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:35:31.876181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aad25d2d-77f0-4ab1-a76f-22820c19fb00 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:31.876663 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aad25d2d-77f0-4ab1-a76f-22820c19fb00 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:31.877088 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aad25d2d-77f0-4ab1-a76f-22820c19fb00 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:31.877772 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aad25d2d-77f0-4ab1-a76f-22820c19fb00 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:31.878217 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aad25d2d-77f0-4ab1-a76f-22820c19fb00 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:31.878629 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aad25d2d-77f0-4ab1-a76f-22820c19fb00 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:31.879033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-cbdcb5a2-1711-4415-853c-fd0ca7655185 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:31.880502 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-cbdcb5a2-1711-4415-853c-fd0ca7655185 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:31.881820 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-cbdcb5a2-1711-4415-853c-fd0ca7655185 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.153697 Oct 27 17:35:31.882598 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 326/619] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:31 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:32.251854 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-aad25d2d-77f0-4ab1-a76f-22820c19fb00 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:32.260072 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-aad25d2d-77f0-4ab1-a76f-22820c19fb00 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1750 microversion: 2.1 time: 0.394973 Oct 27 17:35:32.260636 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 294/620] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:31 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1750 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:35:32.906996 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c814d77c-ea8b-4a1a-bbae-63774b8f0bbc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:32.907629 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c814d77c-ea8b-4a1a-bbae-63774b8f0bbc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:32.916574 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c814d77c-ea8b-4a1a-bbae-63774b8f0bbc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:32.917208 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c814d77c-ea8b-4a1a-bbae-63774b8f0bbc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:32.917647 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c814d77c-ea8b-4a1a-bbae-63774b8f0bbc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:32.918346 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c814d77c-ea8b-4a1a-bbae-63774b8f0bbc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:32.918798 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c814d77c-ea8b-4a1a-bbae-63774b8f0bbc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:32.919220 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c814d77c-ea8b-4a1a-bbae-63774b8f0bbc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:33.112613 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c814d77c-ea8b-4a1a-bbae-63774b8f0bbc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:33.121845 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c814d77c-ea8b-4a1a-bbae-63774b8f0bbc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:33.123844 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c814d77c-ea8b-4a1a-bbae-63774b8f0bbc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:33.125013 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c814d77c-ea8b-4a1a-bbae-63774b8f0bbc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.222432 Oct 27 17:35:33.125808 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 327/621] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:32 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:33.283736 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d3e1fb42-59b0-4297-a8a6-09e5de8c9b18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:33.284361 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d3e1fb42-59b0-4297-a8a6-09e5de8c9b18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:33.291174 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3e1fb42-59b0-4297-a8a6-09e5de8c9b18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:33.291685 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3e1fb42-59b0-4297-a8a6-09e5de8c9b18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:33.292290 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3e1fb42-59b0-4297-a8a6-09e5de8c9b18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:33.292972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3e1fb42-59b0-4297-a8a6-09e5de8c9b18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:33.293418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3e1fb42-59b0-4297-a8a6-09e5de8c9b18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:33.293835 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3e1fb42-59b0-4297-a8a6-09e5de8c9b18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:33.299533 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:35:33.443996 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d3e1fb42-59b0-4297-a8a6-09e5de8c9b18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:33.452275 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d3e1fb42-59b0-4297-a8a6-09e5de8c9b18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1750 microversion: 2.1 time: 0.172339 Oct 27 17:35:33.453075 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 295/622] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:33 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:34.150215 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c094c3f5-e541-447b-a4e0-c9bdc3b8bd0f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:34.150863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c094c3f5-e541-447b-a4e0-c9bdc3b8bd0f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:34.157823 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c094c3f5-e541-447b-a4e0-c9bdc3b8bd0f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:34.158308 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c094c3f5-e541-447b-a4e0-c9bdc3b8bd0f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:34.158753 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c094c3f5-e541-447b-a4e0-c9bdc3b8bd0f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:34.159446 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c094c3f5-e541-447b-a4e0-c9bdc3b8bd0f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:34.159932 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c094c3f5-e541-447b-a4e0-c9bdc3b8bd0f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:34.160361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c094c3f5-e541-447b-a4e0-c9bdc3b8bd0f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:34.296378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c094c3f5-e541-447b-a4e0-c9bdc3b8bd0f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:34.305251 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c094c3f5-e541-447b-a4e0-c9bdc3b8bd0f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:34.306623 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c094c3f5-e541-447b-a4e0-c9bdc3b8bd0f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:34.307801 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c094c3f5-e541-447b-a4e0-c9bdc3b8bd0f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.161422 Oct 27 17:35:34.308351 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 328/623] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:34 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:34.475557 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-00a24f0c-b53b-4b9c-8a41-eeb9918068c2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:34.476328 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-00a24f0c-b53b-4b9c-8a41-eeb9918068c2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:34.483406 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-00a24f0c-b53b-4b9c-8a41-eeb9918068c2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:34.483917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-00a24f0c-b53b-4b9c-8a41-eeb9918068c2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:34.484348 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-00a24f0c-b53b-4b9c-8a41-eeb9918068c2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:34.485025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-00a24f0c-b53b-4b9c-8a41-eeb9918068c2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:34.485474 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-00a24f0c-b53b-4b9c-8a41-eeb9918068c2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:34.485921 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-00a24f0c-b53b-4b9c-8a41-eeb9918068c2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:34.626455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-00a24f0c-b53b-4b9c-8a41-eeb9918068c2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:34.634812 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-00a24f0c-b53b-4b9c-8a41-eeb9918068c2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1755 microversion: 2.1 time: 0.163211 Oct 27 17:35:34.635370 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 296/624] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:34 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:35.333631 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-74343809-0545-4501-8194-16747651dc72 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:35.334242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-74343809-0545-4501-8194-16747651dc72 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:35.340726 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74343809-0545-4501-8194-16747651dc72 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:35.341210 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74343809-0545-4501-8194-16747651dc72 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:35.341648 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74343809-0545-4501-8194-16747651dc72 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:35.342396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74343809-0545-4501-8194-16747651dc72 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:35.342850 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74343809-0545-4501-8194-16747651dc72 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:35.343271 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74343809-0545-4501-8194-16747651dc72 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:35.468557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-74343809-0545-4501-8194-16747651dc72 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:35.477056 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-74343809-0545-4501-8194-16747651dc72 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:35.478760 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-74343809-0545-4501-8194-16747651dc72 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:35.479953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-74343809-0545-4501-8194-16747651dc72 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.150238 Oct 27 17:35:35.480512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 329/625] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:35 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:35.657419 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2f43eb73-0fdb-47e6-87a2-69848b095274 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:35.657961 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2f43eb73-0fdb-47e6-87a2-69848b095274 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:35.664399 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2f43eb73-0fdb-47e6-87a2-69848b095274 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:35.664877 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2f43eb73-0fdb-47e6-87a2-69848b095274 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:35.665305 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2f43eb73-0fdb-47e6-87a2-69848b095274 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:35.665987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2f43eb73-0fdb-47e6-87a2-69848b095274 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:35.666435 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2f43eb73-0fdb-47e6-87a2-69848b095274 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:35.666856 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2f43eb73-0fdb-47e6-87a2-69848b095274 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:35.810446 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2f43eb73-0fdb-47e6-87a2-69848b095274 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:35.819242 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2f43eb73-0fdb-47e6-87a2-69848b095274 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1755 microversion: 2.1 time: 0.165783 Oct 27 17:35:35.819832 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 297/626] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:35 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:36.505390 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-81c65ad2-91c2-4832-bd71-2a12b7865082 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:36.506006 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-81c65ad2-91c2-4832-bd71-2a12b7865082 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:36.512506 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81c65ad2-91c2-4832-bd71-2a12b7865082 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:36.512991 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81c65ad2-91c2-4832-bd71-2a12b7865082 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:36.513427 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81c65ad2-91c2-4832-bd71-2a12b7865082 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:36.514117 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81c65ad2-91c2-4832-bd71-2a12b7865082 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:36.514571 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81c65ad2-91c2-4832-bd71-2a12b7865082 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:36.514999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-81c65ad2-91c2-4832-bd71-2a12b7865082 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:36.643884 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-81c65ad2-91c2-4832-bd71-2a12b7865082 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:36.652522 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-81c65ad2-91c2-4832-bd71-2a12b7865082 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:36.653980 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-81c65ad2-91c2-4832-bd71-2a12b7865082 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:36.655625 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-81c65ad2-91c2-4832-bd71-2a12b7865082 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.154222 Oct 27 17:35:36.656211 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 330/627] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:36 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:36.842331 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8a632d99-23f0-41aa-8496-8888414f41cb tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:36.842888 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8a632d99-23f0-41aa-8496-8888414f41cb tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:36.849290 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8a632d99-23f0-41aa-8496-8888414f41cb tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:36.849770 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8a632d99-23f0-41aa-8496-8888414f41cb tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:36.850202 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8a632d99-23f0-41aa-8496-8888414f41cb tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:36.850888 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8a632d99-23f0-41aa-8496-8888414f41cb tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:36.851338 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8a632d99-23f0-41aa-8496-8888414f41cb tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:36.851792 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8a632d99-23f0-41aa-8496-8888414f41cb tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:36.989916 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8a632d99-23f0-41aa-8496-8888414f41cb tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:36.997939 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8a632d99-23f0-41aa-8496-8888414f41cb tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1755 microversion: 2.1 time: 0.159577 Oct 27 17:35:36.999088 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 298/628] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:36 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:37.680989 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8be5fa39-f2bd-4cd4-a576-a443fb06dc55 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:37.681608 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8be5fa39-f2bd-4cd4-a576-a443fb06dc55 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:37.688442 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8be5fa39-f2bd-4cd4-a576-a443fb06dc55 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:37.688919 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8be5fa39-f2bd-4cd4-a576-a443fb06dc55 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:37.689347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8be5fa39-f2bd-4cd4-a576-a443fb06dc55 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:37.690028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8be5fa39-f2bd-4cd4-a576-a443fb06dc55 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:37.690478 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8be5fa39-f2bd-4cd4-a576-a443fb06dc55 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:37.690892 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8be5fa39-f2bd-4cd4-a576-a443fb06dc55 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:37.818040 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8be5fa39-f2bd-4cd4-a576-a443fb06dc55 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:37.826538 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8be5fa39-f2bd-4cd4-a576-a443fb06dc55 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:37.828109 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8be5fa39-f2bd-4cd4-a576-a443fb06dc55 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:37.829308 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8be5fa39-f2bd-4cd4-a576-a443fb06dc55 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.152288 Oct 27 17:35:37.829836 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 331/629] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:37 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:38.021851 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b6aedd40-3fa8-4ccb-9ea6-9a942e92ef25 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:38.022448 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b6aedd40-3fa8-4ccb-9ea6-9a942e92ef25 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:38.028742 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6aedd40-3fa8-4ccb-9ea6-9a942e92ef25 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:38.029214 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6aedd40-3fa8-4ccb-9ea6-9a942e92ef25 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:38.029637 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6aedd40-3fa8-4ccb-9ea6-9a942e92ef25 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:38.030319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6aedd40-3fa8-4ccb-9ea6-9a942e92ef25 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:38.030760 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6aedd40-3fa8-4ccb-9ea6-9a942e92ef25 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:38.031173 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6aedd40-3fa8-4ccb-9ea6-9a942e92ef25 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:38.171988 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b6aedd40-3fa8-4ccb-9ea6-9a942e92ef25 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:38.180114 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b6aedd40-3fa8-4ccb-9ea6-9a942e92ef25 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1755 microversion: 2.1 time: 0.162058 Oct 27 17:35:38.180686 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 299/630] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:38 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:38.854576 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-54de8be8-59a4-46e5-9a78-06ae28c8c303 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:38.855183 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-54de8be8-59a4-46e5-9a78-06ae28c8c303 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:38.862190 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-54de8be8-59a4-46e5-9a78-06ae28c8c303 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:38.862665 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-54de8be8-59a4-46e5-9a78-06ae28c8c303 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:38.863092 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-54de8be8-59a4-46e5-9a78-06ae28c8c303 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:38.863790 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-54de8be8-59a4-46e5-9a78-06ae28c8c303 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:38.864243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-54de8be8-59a4-46e5-9a78-06ae28c8c303 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:38.864659 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-54de8be8-59a4-46e5-9a78-06ae28c8c303 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:38.995647 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-54de8be8-59a4-46e5-9a78-06ae28c8c303 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:39.004657 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-54de8be8-59a4-46e5-9a78-06ae28c8c303 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:39.006090 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-54de8be8-59a4-46e5-9a78-06ae28c8c303 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:39.007239 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-54de8be8-59a4-46e5-9a78-06ae28c8c303 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.156885 Oct 27 17:35:39.007818 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 332/631] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:38 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:39.202961 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-faca3a61-41d0-48a3-9b19-def1f32fcac1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:39.203505 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-faca3a61-41d0-48a3-9b19-def1f32fcac1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:39.209869 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-faca3a61-41d0-48a3-9b19-def1f32fcac1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:39.210351 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-faca3a61-41d0-48a3-9b19-def1f32fcac1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:39.210782 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-faca3a61-41d0-48a3-9b19-def1f32fcac1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:39.211465 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-faca3a61-41d0-48a3-9b19-def1f32fcac1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:39.211944 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-faca3a61-41d0-48a3-9b19-def1f32fcac1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:39.212372 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-faca3a61-41d0-48a3-9b19-def1f32fcac1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:39.359546 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-faca3a61-41d0-48a3-9b19-def1f32fcac1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:39.367417 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-faca3a61-41d0-48a3-9b19-def1f32fcac1 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1755 microversion: 2.1 time: 0.168983 Oct 27 17:35:39.368013 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 300/632] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:39 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:35:40.033341 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-21fda6a9-0903-4e86-9cbd-f1c36b79d182 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:40.033951 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-21fda6a9-0903-4e86-9cbd-f1c36b79d182 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:40.040363 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21fda6a9-0903-4e86-9cbd-f1c36b79d182 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:40.040846 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21fda6a9-0903-4e86-9cbd-f1c36b79d182 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:40.041284 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21fda6a9-0903-4e86-9cbd-f1c36b79d182 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:40.041975 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21fda6a9-0903-4e86-9cbd-f1c36b79d182 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:40.042436 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21fda6a9-0903-4e86-9cbd-f1c36b79d182 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:40.042864 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21fda6a9-0903-4e86-9cbd-f1c36b79d182 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:40.166058 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-21fda6a9-0903-4e86-9cbd-f1c36b79d182 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:40.174617 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-21fda6a9-0903-4e86-9cbd-f1c36b79d182 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:40.176099 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-21fda6a9-0903-4e86-9cbd-f1c36b79d182 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:40.177249 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-21fda6a9-0903-4e86-9cbd-f1c36b79d182 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.148383 Oct 27 17:35:40.177806 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 333/633] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:40 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:40.390970 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-62d4c456-5980-40e7-a610-25d6163a460d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:40.391571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-62d4c456-5980-40e7-a610-25d6163a460d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:40.397926 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62d4c456-5980-40e7-a610-25d6163a460d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:40.398399 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62d4c456-5980-40e7-a610-25d6163a460d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:40.398828 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62d4c456-5980-40e7-a610-25d6163a460d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:40.399509 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62d4c456-5980-40e7-a610-25d6163a460d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:40.399983 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62d4c456-5980-40e7-a610-25d6163a460d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:40.400399 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62d4c456-5980-40e7-a610-25d6163a460d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:40.544571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-62d4c456-5980-40e7-a610-25d6163a460d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:40.552909 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-62d4c456-5980-40e7-a610-25d6163a460d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1755 microversion: 2.1 time: 0.166458 Oct 27 17:35:40.553672 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 301/634] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:40 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:41.204563 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-cb28646f-371e-4dc9-a475-43dc1d37c583 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:41.205220 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-cb28646f-371e-4dc9-a475-43dc1d37c583 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:41.214817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cb28646f-371e-4dc9-a475-43dc1d37c583 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:41.215354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cb28646f-371e-4dc9-a475-43dc1d37c583 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:41.219225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cb28646f-371e-4dc9-a475-43dc1d37c583 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:41.219225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cb28646f-371e-4dc9-a475-43dc1d37c583 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:41.219225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cb28646f-371e-4dc9-a475-43dc1d37c583 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:41.219225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cb28646f-371e-4dc9-a475-43dc1d37c583 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:41.362008 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-cb28646f-371e-4dc9-a475-43dc1d37c583 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:41.370459 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-cb28646f-371e-4dc9-a475-43dc1d37c583 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:41.371977 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-cb28646f-371e-4dc9-a475-43dc1d37c583 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:41.373157 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-cb28646f-371e-4dc9-a475-43dc1d37c583 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.173553 Oct 27 17:35:41.373717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 334/635] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:41 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:41.576872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b60e3fe6-ab2c-4d97-b20c-b632fecb945f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:41.577595 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b60e3fe6-ab2c-4d97-b20c-b632fecb945f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:41.584274 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b60e3fe6-ab2c-4d97-b20c-b632fecb945f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:41.584758 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b60e3fe6-ab2c-4d97-b20c-b632fecb945f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:41.585191 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b60e3fe6-ab2c-4d97-b20c-b632fecb945f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:41.585881 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b60e3fe6-ab2c-4d97-b20c-b632fecb945f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:41.586331 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b60e3fe6-ab2c-4d97-b20c-b632fecb945f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:41.586759 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b60e3fe6-ab2c-4d97-b20c-b632fecb945f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:41.729456 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b60e3fe6-ab2c-4d97-b20c-b632fecb945f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:41.737781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b60e3fe6-ab2c-4d97-b20c-b632fecb945f tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1755 microversion: 2.1 time: 0.165263 Oct 27 17:35:41.738352 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 302/636] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:41 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:42.398492 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-64abeafa-f2ee-4e41-809a-9463f1d458f8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:42.399143 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-64abeafa-f2ee-4e41-809a-9463f1d458f8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:42.405568 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-64abeafa-f2ee-4e41-809a-9463f1d458f8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:42.406052 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-64abeafa-f2ee-4e41-809a-9463f1d458f8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:42.406496 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-64abeafa-f2ee-4e41-809a-9463f1d458f8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:42.407184 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-64abeafa-f2ee-4e41-809a-9463f1d458f8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:42.407639 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-64abeafa-f2ee-4e41-809a-9463f1d458f8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:42.408104 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-64abeafa-f2ee-4e41-809a-9463f1d458f8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:42.536003 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-64abeafa-f2ee-4e41-809a-9463f1d458f8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:42.544537 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-64abeafa-f2ee-4e41-809a-9463f1d458f8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:42.546475 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-64abeafa-f2ee-4e41-809a-9463f1d458f8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:42.547660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-64abeafa-f2ee-4e41-809a-9463f1d458f8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.153134 Oct 27 17:35:42.548245 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 335/637] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:42 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:42.712658 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-6df9262e-038f-4eca-99dd-103b3b59f57f req-2c8e209b-e807-496a-a48f-9ffcd700ec04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b27a822-4c22-45f0-872b-67e5f360f45e", "name": "network-vif-plugged", "status": "completed", "tag": "8d525473-0013-4431-baf7-e343fbc1a2eb"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:35:42.723054 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-6df9262e-038f-4eca-99dd-103b3b59f57f req-2c8e209b-e807-496a-a48f-9ffcd700ec04 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:42.723545 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-6df9262e-038f-4eca-99dd-103b3b59f57f req-2c8e209b-e807-496a-a48f-9ffcd700ec04 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:42.724022 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-6df9262e-038f-4eca-99dd-103b3b59f57f req-2c8e209b-e807-496a-a48f-9ffcd700ec04 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:42.736078 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-6df9262e-038f-4eca-99dd-103b3b59f57f req-2c8e209b-e807-496a-a48f-9ffcd700ec04 service nova] Creating event network-vif-plugged:8d525473-0013-4431-baf7-e343fbc1a2eb for instance 2b27a822-4c22-45f0-872b-67e5f360f45e on hv-cinder-86283 Oct 27 17:35:42.740913 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-6df9262e-038f-4eca-99dd-103b3b59f57f req-2c8e209b-e807-496a-a48f-9ffcd700ec04 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031936 Oct 27 17:35:42.741523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 303/638] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:35:42.760435 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-201dacd0-b0c8-4cee-9c00-7c784cf4a374 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:42.761080 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-201dacd0-b0c8-4cee-9c00-7c784cf4a374 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:42.767056 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-201dacd0-b0c8-4cee-9c00-7c784cf4a374 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:42.767539 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-201dacd0-b0c8-4cee-9c00-7c784cf4a374 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:42.768005 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-201dacd0-b0c8-4cee-9c00-7c784cf4a374 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:42.768700 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-201dacd0-b0c8-4cee-9c00-7c784cf4a374 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:42.769156 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-201dacd0-b0c8-4cee-9c00-7c784cf4a374 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:42.769582 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-201dacd0-b0c8-4cee-9c00-7c784cf4a374 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:42.911610 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-201dacd0-b0c8-4cee-9c00-7c784cf4a374 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:42.920421 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-201dacd0-b0c8-4cee-9c00-7c784cf4a374 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1755 microversion: 2.1 time: 0.163275 Oct 27 17:35:42.921008 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 336/639] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:42 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:43.574397 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-aae9656e-b021-4693-b694-eb064ea9f886 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:43.575091 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-aae9656e-b021-4693-b694-eb064ea9f886 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:43.582140 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aae9656e-b021-4693-b694-eb064ea9f886 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:43.582617 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aae9656e-b021-4693-b694-eb064ea9f886 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:43.583049 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aae9656e-b021-4693-b694-eb064ea9f886 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:43.583755 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aae9656e-b021-4693-b694-eb064ea9f886 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:43.584210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aae9656e-b021-4693-b694-eb064ea9f886 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:43.584628 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aae9656e-b021-4693-b694-eb064ea9f886 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:43.711932 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-aae9656e-b021-4693-b694-eb064ea9f886 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:43.722602 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-aae9656e-b021-4693-b694-eb064ea9f886 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:43.724062 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-aae9656e-b021-4693-b694-eb064ea9f886 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:43.725212 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-aae9656e-b021-4693-b694-eb064ea9f886 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.155092 Oct 27 17:35:43.725770 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 304/640] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:43 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:43.943783 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-10c6e344-fa85-405c-8b16-9126f637297d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:43.944334 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-10c6e344-fa85-405c-8b16-9126f637297d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:43.950785 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-10c6e344-fa85-405c-8b16-9126f637297d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:43.951270 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-10c6e344-fa85-405c-8b16-9126f637297d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:43.951703 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-10c6e344-fa85-405c-8b16-9126f637297d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:43.952409 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-10c6e344-fa85-405c-8b16-9126f637297d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:43.952858 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-10c6e344-fa85-405c-8b16-9126f637297d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:43.953279 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-10c6e344-fa85-405c-8b16-9126f637297d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:44.092559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-10c6e344-fa85-405c-8b16-9126f637297d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:44.100548 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-10c6e344-fa85-405c-8b16-9126f637297d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1755 microversion: 2.1 time: 0.160788 Oct 27 17:35:44.101103 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 337/641] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:43 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:44.750882 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9623d5cc-1909-4d8e-bd83-47c8fc51e8e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:44.751481 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9623d5cc-1909-4d8e-bd83-47c8fc51e8e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:44.757917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9623d5cc-1909-4d8e-bd83-47c8fc51e8e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:44.758389 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9623d5cc-1909-4d8e-bd83-47c8fc51e8e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:44.758811 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9623d5cc-1909-4d8e-bd83-47c8fc51e8e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:44.759482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9623d5cc-1909-4d8e-bd83-47c8fc51e8e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:44.759950 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9623d5cc-1909-4d8e-bd83-47c8fc51e8e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:44.760364 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9623d5cc-1909-4d8e-bd83-47c8fc51e8e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:44.889268 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9623d5cc-1909-4d8e-bd83-47c8fc51e8e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:44.897799 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9623d5cc-1909-4d8e-bd83-47c8fc51e8e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:44.899219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9623d5cc-1909-4d8e-bd83-47c8fc51e8e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:44.900429 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9623d5cc-1909-4d8e-bd83-47c8fc51e8e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.153411 Oct 27 17:35:44.900976 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 305/642] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:44 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:45.123588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-12485fe3-cbdc-438b-92eb-e95f7c73999d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:45.124160 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-12485fe3-cbdc-438b-92eb-e95f7c73999d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:45.130540 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-12485fe3-cbdc-438b-92eb-e95f7c73999d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:45.131022 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-12485fe3-cbdc-438b-92eb-e95f7c73999d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:45.131460 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-12485fe3-cbdc-438b-92eb-e95f7c73999d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:45.132191 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-12485fe3-cbdc-438b-92eb-e95f7c73999d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:45.132648 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-12485fe3-cbdc-438b-92eb-e95f7c73999d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:45.133076 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-12485fe3-cbdc-438b-92eb-e95f7c73999d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:45.271522 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-12485fe3-cbdc-438b-92eb-e95f7c73999d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:45.279786 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-12485fe3-cbdc-438b-92eb-e95f7c73999d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1755 microversion: 2.1 time: 0.160159 Oct 27 17:35:45.280393 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 338/643] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:45 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:45.926127 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-394c5d48-24d9-4511-921c-78d4f56c92d5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:45.926682 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-394c5d48-24d9-4511-921c-78d4f56c92d5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:45.933035 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-394c5d48-24d9-4511-921c-78d4f56c92d5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:45.933505 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-394c5d48-24d9-4511-921c-78d4f56c92d5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:45.933932 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-394c5d48-24d9-4511-921c-78d4f56c92d5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:45.934609 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-394c5d48-24d9-4511-921c-78d4f56c92d5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:45.935052 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-394c5d48-24d9-4511-921c-78d4f56c92d5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:45.935560 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-394c5d48-24d9-4511-921c-78d4f56c92d5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:46.065068 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-394c5d48-24d9-4511-921c-78d4f56c92d5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:46.073775 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-394c5d48-24d9-4511-921c-78d4f56c92d5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:46.075205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-394c5d48-24d9-4511-921c-78d4f56c92d5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:46.076408 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-394c5d48-24d9-4511-921c-78d4f56c92d5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1808 microversion: 2.20 time: 0.154291 Oct 27 17:35:46.079746 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 306/644] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:45 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:46.302310 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4a853c3d-c3d0-45cf-ae6f-360e9e636114 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:46.302887 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4a853c3d-c3d0-45cf-ae6f-360e9e636114 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:46.309581 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4a853c3d-c3d0-45cf-ae6f-360e9e636114 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:46.310063 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4a853c3d-c3d0-45cf-ae6f-360e9e636114 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:46.310503 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4a853c3d-c3d0-45cf-ae6f-360e9e636114 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:46.311196 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4a853c3d-c3d0-45cf-ae6f-360e9e636114 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:46.311645 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4a853c3d-c3d0-45cf-ae6f-360e9e636114 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:46.312099 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4a853c3d-c3d0-45cf-ae6f-360e9e636114 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:46.464142 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4a853c3d-c3d0-45cf-ae6f-360e9e636114 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:46.473017 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4a853c3d-c3d0-45cf-ae6f-360e9e636114 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1755 microversion: 2.1 time: 0.174571 Oct 27 17:35:46.473587 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 339/645] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:46 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:47.101985 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-cb36df65-73d7-4a77-8f7d-162fdddeda26 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:47.102850 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-cb36df65-73d7-4a77-8f7d-162fdddeda26 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:47.109733 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb36df65-73d7-4a77-8f7d-162fdddeda26 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:47.110209 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb36df65-73d7-4a77-8f7d-162fdddeda26 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:47.110639 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb36df65-73d7-4a77-8f7d-162fdddeda26 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:47.111320 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb36df65-73d7-4a77-8f7d-162fdddeda26 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:47.111792 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb36df65-73d7-4a77-8f7d-162fdddeda26 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:47.112213 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cb36df65-73d7-4a77-8f7d-162fdddeda26 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:47.239392 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-cb36df65-73d7-4a77-8f7d-162fdddeda26 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:47.247897 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-cb36df65-73d7-4a77-8f7d-162fdddeda26 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:47.249908 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-cb36df65-73d7-4a77-8f7d-162fdddeda26 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:47.251056 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-cb36df65-73d7-4a77-8f7d-162fdddeda26 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1795 microversion: 2.20 time: 0.152966 Oct 27 17:35:47.251619 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 307/646] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:35:47 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1795 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:35:47.496647 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-886e441c-c5a7-4f4b-babb-ccbff471c7c9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:47.497257 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-886e441c-c5a7-4f4b-babb-ccbff471c7c9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:47.503690 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-886e441c-c5a7-4f4b-babb-ccbff471c7c9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:47.504197 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-886e441c-c5a7-4f4b-babb-ccbff471c7c9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:47.504625 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-886e441c-c5a7-4f4b-babb-ccbff471c7c9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:47.505304 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-886e441c-c5a7-4f4b-babb-ccbff471c7c9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:47.505749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-886e441c-c5a7-4f4b-babb-ccbff471c7c9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:47.506171 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-886e441c-c5a7-4f4b-babb-ccbff471c7c9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:47.643399 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-886e441c-c5a7-4f4b-babb-ccbff471c7c9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:47.651566 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-886e441c-c5a7-4f4b-babb-ccbff471c7c9 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1755 microversion: 2.1 time: 0.158808 Oct 27 17:35:47.652163 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 340/647] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:47 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:48.675472 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7138ebdc-2ae3-4530-8c59-edb9dd626104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:48.676161 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7138ebdc-2ae3-4530-8c59-edb9dd626104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:48.682498 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7138ebdc-2ae3-4530-8c59-edb9dd626104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:48.682972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7138ebdc-2ae3-4530-8c59-edb9dd626104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:48.683400 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7138ebdc-2ae3-4530-8c59-edb9dd626104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:48.684107 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7138ebdc-2ae3-4530-8c59-edb9dd626104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:48.684559 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7138ebdc-2ae3-4530-8c59-edb9dd626104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:48.684977 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7138ebdc-2ae3-4530-8c59-edb9dd626104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:48.826053 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7138ebdc-2ae3-4530-8c59-edb9dd626104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:48.834120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7138ebdc-2ae3-4530-8c59-edb9dd626104 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1755 microversion: 2.1 time: 0.162475 Oct 27 17:35:48.834686 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 308/648] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:48 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:49.857452 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a49fb373-fb31-4221-a37e-7189c5df8359 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:49.858514 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a49fb373-fb31-4221-a37e-7189c5df8359 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:49.865339 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a49fb373-fb31-4221-a37e-7189c5df8359 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:49.865842 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a49fb373-fb31-4221-a37e-7189c5df8359 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:49.866276 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a49fb373-fb31-4221-a37e-7189c5df8359 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:49.866969 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a49fb373-fb31-4221-a37e-7189c5df8359 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:49.867419 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a49fb373-fb31-4221-a37e-7189c5df8359 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:49.867875 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a49fb373-fb31-4221-a37e-7189c5df8359 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:50.010008 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a49fb373-fb31-4221-a37e-7189c5df8359 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:50.018081 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a49fb373-fb31-4221-a37e-7189c5df8359 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1755 microversion: 2.1 time: 0.164531 Oct 27 17:35:50.018644 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 341/649] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:49 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:35:51.041226 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a2949176-8b49-49e8-b996-b4c884a8d2aa tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:35:51.041831 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a2949176-8b49-49e8-b996-b4c884a8d2aa tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:35:51.044573 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=44 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:35:51.049968 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a2949176-8b49-49e8-b996-b4c884a8d2aa tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:51.050449 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a2949176-8b49-49e8-b996-b4c884a8d2aa tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:51.050885 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a2949176-8b49-49e8-b996-b4c884a8d2aa tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:51.051571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a2949176-8b49-49e8-b996-b4c884a8d2aa tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:35:51.052047 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a2949176-8b49-49e8-b996-b4c884a8d2aa tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:35:51.052490 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a2949176-8b49-49e8-b996-b4c884a8d2aa tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:35:51.192265 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a2949176-8b49-49e8-b996-b4c884a8d2aa tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:35:51.200482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a2949176-8b49-49e8-b996-b4c884a8d2aa tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1758 microversion: 2.1 time: 0.163089 Oct 27 17:35:51.201055 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 309/650] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:35:51 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:11.726843 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=41 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:36:11.727872 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=91 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:36:11.826222 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1a11dab1-0bae-4d12-984e-fced39883303 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5f57023-dd35-46f2-a499-a0c3d48f52c8"}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:36:11.828882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-1a11dab1-0bae-4d12-984e-fced39883303 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:11.834812 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1a11dab1-0bae-4d12-984e-fced39883303 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:11.835296 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1a11dab1-0bae-4d12-984e-fced39883303 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:11.835747 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1a11dab1-0bae-4d12-984e-fced39883303 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:11.836438 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1a11dab1-0bae-4d12-984e-fced39883303 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:11.836887 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1a11dab1-0bae-4d12-984e-fced39883303 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:11.837308 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1a11dab1-0bae-4d12-984e-fced39883303 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:12.136366 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1a11dab1-0bae-4d12-984e-fced39883303 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "POST /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.414169 Oct 27 17:36:12.136986 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 342/651] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Oct 27 17:36:11 2022] POST /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:36:19.670038 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-de0157a9-aaf6-41e5-95d4-672d9d4519f1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:36:19.672338 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-de0157a9-aaf6-41e5-95d4-672d9d4519f1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:19.674375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:36:19.675021 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=85 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:36:19.681305 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-de0157a9-aaf6-41e5-95d4-672d9d4519f1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:19.681785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-de0157a9-aaf6-41e5-95d4-672d9d4519f1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:19.682216 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-de0157a9-aaf6-41e5-95d4-672d9d4519f1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:19.682900 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-de0157a9-aaf6-41e5-95d4-672d9d4519f1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:19.683349 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-de0157a9-aaf6-41e5-95d4-672d9d4519f1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:19.683860 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-de0157a9-aaf6-41e5-95d4-672d9d4519f1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:19.707569 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-de0157a9-aaf6-41e5-95d4-672d9d4519f1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lazy-loading 'flavor' on Instance uuid 41584d40-839e-4610-9c2b-7291f0d8d790 {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:36:19.826347 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-de0157a9-aaf6-41e5-95d4-672d9d4519f1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "POST /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/action" status: 200 len: 32 microversion: 2.1 time: 0.160311 Oct 27 17:36:19.826878 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 310/652] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Oct 27 17:36:19 2022] POST /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 17:36:19.837312 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2efe22b0-4a2b-43ba-b707-826f91dd8d93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:19.838016 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2efe22b0-4a2b-43ba-b707-826f91dd8d93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:19.844568 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2efe22b0-4a2b-43ba-b707-826f91dd8d93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:19.845032 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2efe22b0-4a2b-43ba-b707-826f91dd8d93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:19.845528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2efe22b0-4a2b-43ba-b707-826f91dd8d93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:19.846229 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2efe22b0-4a2b-43ba-b707-826f91dd8d93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:19.846731 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2efe22b0-4a2b-43ba-b707-826f91dd8d93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:19.847161 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2efe22b0-4a2b-43ba-b707-826f91dd8d93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:20.021488 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2efe22b0-4a2b-43ba-b707-826f91dd8d93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:20.029901 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2efe22b0-4a2b-43ba-b707-826f91dd8d93 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1734 microversion: 2.1 time: 0.197307 Oct 27 17:36:20.030695 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 343/653] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:19 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1734 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:21.054652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-43650609-115a-4d65-9331-853de4ea6861 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:21.055340 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-43650609-115a-4d65-9331-853de4ea6861 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:21.062056 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43650609-115a-4d65-9331-853de4ea6861 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:21.062533 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43650609-115a-4d65-9331-853de4ea6861 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:21.063029 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43650609-115a-4d65-9331-853de4ea6861 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:21.063728 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43650609-115a-4d65-9331-853de4ea6861 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:21.064203 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43650609-115a-4d65-9331-853de4ea6861 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:21.064616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43650609-115a-4d65-9331-853de4ea6861 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:21.194185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-43650609-115a-4d65-9331-853de4ea6861 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:21.202855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-43650609-115a-4d65-9331-853de4ea6861 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1734 microversion: 2.1 time: 0.152966 Oct 27 17:36:21.203413 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 311/654] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:21 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:22.225598 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c5576b7a-aba1-4d16-b89e-318cfd0ae612 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:22.226238 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c5576b7a-aba1-4d16-b89e-318cfd0ae612 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:22.232993 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c5576b7a-aba1-4d16-b89e-318cfd0ae612 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:22.233468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c5576b7a-aba1-4d16-b89e-318cfd0ae612 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:22.233898 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c5576b7a-aba1-4d16-b89e-318cfd0ae612 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:22.234577 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c5576b7a-aba1-4d16-b89e-318cfd0ae612 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:22.235024 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c5576b7a-aba1-4d16-b89e-318cfd0ae612 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:22.235441 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c5576b7a-aba1-4d16-b89e-318cfd0ae612 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:22.364481 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c5576b7a-aba1-4d16-b89e-318cfd0ae612 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:22.372762 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c5576b7a-aba1-4d16-b89e-318cfd0ae612 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1734 microversion: 2.1 time: 0.150969 Oct 27 17:36:22.373522 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 344/655] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:22 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:23.396235 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f1df6e63-2d7c-4a1b-aab2-83b5fee142c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:23.396861 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-f1df6e63-2d7c-4a1b-aab2-83b5fee142c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:23.403763 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f1df6e63-2d7c-4a1b-aab2-83b5fee142c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:23.404238 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f1df6e63-2d7c-4a1b-aab2-83b5fee142c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:23.404665 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f1df6e63-2d7c-4a1b-aab2-83b5fee142c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:23.405341 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f1df6e63-2d7c-4a1b-aab2-83b5fee142c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:23.405785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f1df6e63-2d7c-4a1b-aab2-83b5fee142c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:23.406203 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f1df6e63-2d7c-4a1b-aab2-83b5fee142c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:23.532285 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f1df6e63-2d7c-4a1b-aab2-83b5fee142c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:23.540353 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f1df6e63-2d7c-4a1b-aab2-83b5fee142c6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1734 microversion: 2.1 time: 0.147955 Oct 27 17:36:23.540916 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 312/656] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:23 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:24.562477 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4d33cd39-7443-4dc8-8b17-b57b1c7e3327 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:24.563087 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4d33cd39-7443-4dc8-8b17-b57b1c7e3327 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:24.569468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4d33cd39-7443-4dc8-8b17-b57b1c7e3327 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:24.569951 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4d33cd39-7443-4dc8-8b17-b57b1c7e3327 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:24.570385 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4d33cd39-7443-4dc8-8b17-b57b1c7e3327 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:24.571066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4d33cd39-7443-4dc8-8b17-b57b1c7e3327 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:24.571517 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4d33cd39-7443-4dc8-8b17-b57b1c7e3327 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:24.571982 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4d33cd39-7443-4dc8-8b17-b57b1c7e3327 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:24.698857 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4d33cd39-7443-4dc8-8b17-b57b1c7e3327 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:24.707447 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4d33cd39-7443-4dc8-8b17-b57b1c7e3327 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1734 microversion: 2.1 time: 0.148869 Oct 27 17:36:24.708038 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 345/657] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:24 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:25.730021 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a5516e35-2296-4a31-abe0-c4eda28f01e9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:25.730631 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a5516e35-2296-4a31-abe0-c4eda28f01e9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:25.737652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a5516e35-2296-4a31-abe0-c4eda28f01e9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:25.738127 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a5516e35-2296-4a31-abe0-c4eda28f01e9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:25.738559 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a5516e35-2296-4a31-abe0-c4eda28f01e9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:25.739246 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a5516e35-2296-4a31-abe0-c4eda28f01e9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:25.739696 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a5516e35-2296-4a31-abe0-c4eda28f01e9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:25.740141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a5516e35-2296-4a31-abe0-c4eda28f01e9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:25.866420 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a5516e35-2296-4a31-abe0-c4eda28f01e9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:25.874712 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a5516e35-2296-4a31-abe0-c4eda28f01e9 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1734 microversion: 2.1 time: 0.148767 Oct 27 17:36:25.875281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 313/658] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:25 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:26.899290 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5718ca21-e01b-4d56-a49d-7382a30efdec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:26.899872 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-5718ca21-e01b-4d56-a49d-7382a30efdec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:26.906822 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5718ca21-e01b-4d56-a49d-7382a30efdec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:26.907308 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5718ca21-e01b-4d56-a49d-7382a30efdec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:26.907771 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5718ca21-e01b-4d56-a49d-7382a30efdec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:26.908466 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5718ca21-e01b-4d56-a49d-7382a30efdec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:26.908938 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5718ca21-e01b-4d56-a49d-7382a30efdec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:26.909343 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5718ca21-e01b-4d56-a49d-7382a30efdec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:27.033844 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-5718ca21-e01b-4d56-a49d-7382a30efdec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:27.042018 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5718ca21-e01b-4d56-a49d-7382a30efdec tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1734 microversion: 2.1 time: 0.146675 Oct 27 17:36:27.042635 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 346/659] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:26 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:28.065095 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7da970f8-38e2-4389-8ca7-6a7aae766af2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:28.065700 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7da970f8-38e2-4389-8ca7-6a7aae766af2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:28.072114 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7da970f8-38e2-4389-8ca7-6a7aae766af2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:28.072528 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7da970f8-38e2-4389-8ca7-6a7aae766af2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:28.072958 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7da970f8-38e2-4389-8ca7-6a7aae766af2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:28.073636 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7da970f8-38e2-4389-8ca7-6a7aae766af2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:28.074079 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7da970f8-38e2-4389-8ca7-6a7aae766af2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:28.074492 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7da970f8-38e2-4389-8ca7-6a7aae766af2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:28.208599 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7da970f8-38e2-4389-8ca7-6a7aae766af2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:28.217328 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7da970f8-38e2-4389-8ca7-6a7aae766af2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1734 microversion: 2.1 time: 0.156095 Oct 27 17:36:28.217893 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 314/660] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:28 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:29.242204 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5f0e8e1c-40b1-4f14-9b6c-b901d30eeb27 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:29.242817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-5f0e8e1c-40b1-4f14-9b6c-b901d30eeb27 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:29.249715 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5f0e8e1c-40b1-4f14-9b6c-b901d30eeb27 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:29.250199 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5f0e8e1c-40b1-4f14-9b6c-b901d30eeb27 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:29.250635 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5f0e8e1c-40b1-4f14-9b6c-b901d30eeb27 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:29.251320 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5f0e8e1c-40b1-4f14-9b6c-b901d30eeb27 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:29.251827 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5f0e8e1c-40b1-4f14-9b6c-b901d30eeb27 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:29.252231 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5f0e8e1c-40b1-4f14-9b6c-b901d30eeb27 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:29.379101 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-5f0e8e1c-40b1-4f14-9b6c-b901d30eeb27 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:29.388919 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5f0e8e1c-40b1-4f14-9b6c-b901d30eeb27 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1734 microversion: 2.1 time: 0.149803 Oct 27 17:36:29.389654 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 347/661] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:29 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:30.411902 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f4ea8bdc-c74c-4227-b4fb-88acc2611b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:30.412507 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-f4ea8bdc-c74c-4227-b4fb-88acc2611b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:30.418991 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4ea8bdc-c74c-4227-b4fb-88acc2611b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:30.419463 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4ea8bdc-c74c-4227-b4fb-88acc2611b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:30.419922 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4ea8bdc-c74c-4227-b4fb-88acc2611b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:30.420597 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4ea8bdc-c74c-4227-b4fb-88acc2611b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:30.421037 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4ea8bdc-c74c-4227-b4fb-88acc2611b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:30.421449 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4ea8bdc-c74c-4227-b4fb-88acc2611b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:30.549419 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f4ea8bdc-c74c-4227-b4fb-88acc2611b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:30.557675 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f4ea8bdc-c74c-4227-b4fb-88acc2611b8c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1734 microversion: 2.1 time: 0.149634 Oct 27 17:36:30.558228 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 315/662] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:30 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:31.581118 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-46803a1f-39b2-4cfc-bfdd-37756859441d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:31.581754 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-46803a1f-39b2-4cfc-bfdd-37756859441d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:31.588201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-46803a1f-39b2-4cfc-bfdd-37756859441d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:31.588678 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-46803a1f-39b2-4cfc-bfdd-37756859441d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:31.589103 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-46803a1f-39b2-4cfc-bfdd-37756859441d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:31.589780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-46803a1f-39b2-4cfc-bfdd-37756859441d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:31.590783 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-46803a1f-39b2-4cfc-bfdd-37756859441d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:31.591201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-46803a1f-39b2-4cfc-bfdd-37756859441d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:31.720876 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-46803a1f-39b2-4cfc-bfdd-37756859441d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:31.729326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-46803a1f-39b2-4cfc-bfdd-37756859441d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1734 microversion: 2.1 time: 0.152142 Oct 27 17:36:31.729895 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 348/663] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:31 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:32.299460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6af56887-8b59-4e95-98bd-454fd30a7f24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:32.299994 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6af56887-8b59-4e95-98bd-454fd30a7f24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:32.305868 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6af56887-8b59-4e95-98bd-454fd30a7f24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:32.306338 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6af56887-8b59-4e95-98bd-454fd30a7f24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:32.306763 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6af56887-8b59-4e95-98bd-454fd30a7f24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:32.307440 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6af56887-8b59-4e95-98bd-454fd30a7f24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:32.307911 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6af56887-8b59-4e95-98bd-454fd30a7f24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:32.308331 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6af56887-8b59-4e95-98bd-454fd30a7f24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:32.433585 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-6af56887-8b59-4e95-98bd-454fd30a7f24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lazy-loading 'services' on Instance uuid 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:36:32.546140 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6af56887-8b59-4e95-98bd-454fd30a7f24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/os-volume_attachments/a38355ee-0da9-42ca-8b4f-7de71380925b" status: 202 len: 0 microversion: 2.1 time: 0.348188 Oct 27 17:36:32.546704 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 316/664] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Oct 27 17:36:32 2022] DELETE /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/os-volume_attachments/a38355ee-0da9-42ca-8b4f-7de71380925b => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:36:32.753309 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-07c7aa15-9a08-4535-940b-50beb12736b1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:32.753873 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-07c7aa15-9a08-4535-940b-50beb12736b1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:32.760408 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-07c7aa15-9a08-4535-940b-50beb12736b1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:32.760916 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-07c7aa15-9a08-4535-940b-50beb12736b1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:32.761351 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-07c7aa15-9a08-4535-940b-50beb12736b1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:32.762526 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-07c7aa15-9a08-4535-940b-50beb12736b1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:32.762974 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-07c7aa15-9a08-4535-940b-50beb12736b1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:32.763394 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-07c7aa15-9a08-4535-940b-50beb12736b1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:32.888440 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-07c7aa15-9a08-4535-940b-50beb12736b1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:32.896557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-07c7aa15-9a08-4535-940b-50beb12736b1 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1734 microversion: 2.1 time: 0.147219 Oct 27 17:36:32.897118 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 349/665] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:32 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:33.921597 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-dbe9bbbe-6650-4f5f-94e9-a75d5a30d813 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:33.922198 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-dbe9bbbe-6650-4f5f-94e9-a75d5a30d813 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:33.928854 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dbe9bbbe-6650-4f5f-94e9-a75d5a30d813 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:33.929322 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dbe9bbbe-6650-4f5f-94e9-a75d5a30d813 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:33.929746 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dbe9bbbe-6650-4f5f-94e9-a75d5a30d813 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:33.930426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dbe9bbbe-6650-4f5f-94e9-a75d5a30d813 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:33.930867 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dbe9bbbe-6650-4f5f-94e9-a75d5a30d813 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:33.931279 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dbe9bbbe-6650-4f5f-94e9-a75d5a30d813 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:34.065961 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-dbe9bbbe-6650-4f5f-94e9-a75d5a30d813 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:34.074013 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-dbe9bbbe-6650-4f5f-94e9-a75d5a30d813 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1734 microversion: 2.1 time: 0.157873 Oct 27 17:36:34.074574 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 317/666] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:33 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:35.096752 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-743f60ac-2085-40e8-9e1c-d02b6f829497 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:35.097366 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-743f60ac-2085-40e8-9e1c-d02b6f829497 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:35.103981 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-743f60ac-2085-40e8-9e1c-d02b6f829497 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:35.104465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-743f60ac-2085-40e8-9e1c-d02b6f829497 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:35.104904 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-743f60ac-2085-40e8-9e1c-d02b6f829497 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:35.106085 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-743f60ac-2085-40e8-9e1c-d02b6f829497 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:35.106541 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-743f60ac-2085-40e8-9e1c-d02b6f829497 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:35.106965 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-743f60ac-2085-40e8-9e1c-d02b6f829497 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:35.238019 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-743f60ac-2085-40e8-9e1c-d02b6f829497 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:35.247099 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-743f60ac-2085-40e8-9e1c-d02b6f829497 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1734 microversion: 2.1 time: 0.154255 Oct 27 17:36:35.247677 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 350/667] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:35 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:35.778154 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ee140553-9afc-4842-8802-00e41b3d2345 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:36:35.784545 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ee140553-9afc-4842-8802-00e41b3d2345 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:35.785019 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ee140553-9afc-4842-8802-00e41b3d2345 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:35.785442 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ee140553-9afc-4842-8802-00e41b3d2345 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:35.810020 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ee140553-9afc-4842-8802-00e41b3d2345 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Going to try to stop instance {{(pid=119046) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 17:36:35.850964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ee140553-9afc-4842-8802-00e41b3d2345 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "POST /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/action" status: 202 len: 0 microversion: 2.1 time: 0.076955 Oct 27 17:36:35.851849 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 318/668] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Oct 27 17:36:35 2022] POST /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:36:35.859945 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4ae7909a-4057-4201-9066-b49c0c825caf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:35.860559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4ae7909a-4057-4201-9066-b49c0c825caf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:35.866495 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4ae7909a-4057-4201-9066-b49c0c825caf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:35.866978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4ae7909a-4057-4201-9066-b49c0c825caf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:35.867426 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4ae7909a-4057-4201-9066-b49c0c825caf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:35.868144 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4ae7909a-4057-4201-9066-b49c0c825caf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:35.868604 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4ae7909a-4057-4201-9066-b49c0c825caf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:35.869025 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4ae7909a-4057-4201-9066-b49c0c825caf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:35.994803 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4ae7909a-4057-4201-9066-b49c0c825caf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:36.003023 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4ae7909a-4057-4201-9066-b49c0c825caf tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1676 microversion: 2.1 time: 0.147008 Oct 27 17:36:36.003587 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 351/669] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:35 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:36.271913 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a12af80b-cef8-435f-a4e2-8def33c5d733 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:36.272599 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a12af80b-cef8-435f-a4e2-8def33c5d733 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:36.279183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a12af80b-cef8-435f-a4e2-8def33c5d733 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:36.279652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a12af80b-cef8-435f-a4e2-8def33c5d733 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:36.280105 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a12af80b-cef8-435f-a4e2-8def33c5d733 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:36.280779 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a12af80b-cef8-435f-a4e2-8def33c5d733 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:36.281221 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a12af80b-cef8-435f-a4e2-8def33c5d733 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:36.281633 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a12af80b-cef8-435f-a4e2-8def33c5d733 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:36.410125 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a12af80b-cef8-435f-a4e2-8def33c5d733 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:36.418292 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a12af80b-cef8-435f-a4e2-8def33c5d733 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1714 microversion: 2.1 time: 0.150893 Oct 27 17:36:36.418836 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 319/670] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:36 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1714 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:36.480770 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-392f055a-262f-4c91-bb6a-bd618db88518 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:36.481295 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-392f055a-262f-4c91-bb6a-bd618db88518 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:36.487755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-392f055a-262f-4c91-bb6a-bd618db88518 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:36.488251 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-392f055a-262f-4c91-bb6a-bd618db88518 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:36.488696 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-392f055a-262f-4c91-bb6a-bd618db88518 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:36.489384 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-392f055a-262f-4c91-bb6a-bd618db88518 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:36.489841 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-392f055a-262f-4c91-bb6a-bd618db88518 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:36.490265 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-392f055a-262f-4c91-bb6a-bd618db88518 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:36.613283 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-392f055a-262f-4c91-bb6a-bd618db88518 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] HTTP exception thrown: Cannot 'detach_volume' instance 41584d40-839e-4610-9c2b-7291f0d8d790 while it is in vm_state rescued Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-392f055a-262f-4c91-bb6a-bd618db88518 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Request method failure captured: Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: DELETE /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-volume_attachments/f5f57023-dd35-46f2-a499-a0c3d48f52c8 HTTP/1.1 Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA6QQ2Xe-RueSZa98b1WeX08eTwljkpEVfpwUa3_6OScj4PL9zKGISZTxFfRUWVHCjOh7d01WrvQG15DDLAs0QSPfgfc14moQRiXavFZxgaAAOcGU4FOVDxLJFAwl_ReXyMnJxpnmS-6FQDky2vh8WzLt57pts-AbYVWOip7qcpMPc Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: e29292a8f0184800a931a0cbd8c72bf8 Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1280306624 Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:36:36.614870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:36:36.616497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e29292a8f0184800a931a0cbd8c72bf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e29292a8f0184800a931a0cbd8c72bf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e29292a8f0184800a931a0cbd8c72bf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e29292a8f0184800a931a0cbd8c72bf8"}]}] Oct 27 17:36:36.616497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1280306624 Oct 27 17:36:36.616497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: e29292a8f0184800a931a0cbd8c72bf8 Oct 27 17:36:36.616497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1280306624 Oct 27 17:36:36.616497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-ServerRescueNegativeTestJSON-1280306624-project Oct 27 17:36:36.616497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:36:36.616497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:36:36.616497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 8c8a2448e10b4ff39adf43a9581cb794 Oct 27 17:36:36.616497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1280306624-project Oct 27 17:36:36.616497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:36:36.616497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Cannot 'detach_volume' instance 41584d40-839e-4610-9c2b-7291f0d8d790 while it is in vm_state rescued Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'server_id': '41584d40-839e-4610-9c2b-7291f0d8d790', 'id': 'f5f57023-dd35-46f2-a499-a0c3d48f52c8'} Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 41584d40-839e-4610-9c2b-7291f0d8d790 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:36:36.617253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:36:36.618636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 27 17:36:36.618636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 17:36:36.618636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 17:36:36.618636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 17:36:36.618636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 41584d40-839e-4610-9c2b-7291f0d8d790 while it is in vm_state rescued Oct 27 17:36:36.618636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:36:36.618636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:36:36.618636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:36:36.618636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:36:36.618636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:36:36.618636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:36:36.618636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:36:36.618636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:36:36.618636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 41584d40-839e-4610-9c2b-7291f0d8d790 while it is in vm_state rescued Oct 27 17:36:36.618636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:36:36.618636 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-392f055a-262f-4c91-bb6a-bd618db88518 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Returning 409 to user: Cannot 'detach_volume' instance 41584d40-839e-4610-9c2b-7291f0d8d790 while it is in vm_state rescued {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:36:36.619855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-392f055a-262f-4c91-bb6a-bd618db88518 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "DELETE /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-volume_attachments/f5f57023-dd35-46f2-a499-a0c3d48f52c8" status: 409 len: 152 microversion: 2.1 time: 0.139870 Oct 27 17:36:36.619855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 352/671] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Oct 27 17:36:36 2022] DELETE /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-volume_attachments/f5f57023-dd35-46f2-a499-a0c3d48f52c8 => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 17:36:36.627474 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3b0431f3-818f-4d90-9b63-239a9e3830a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:36:36.628031 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-3b0431f3-818f-4d90-9b63-239a9e3830a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:36.633845 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3b0431f3-818f-4d90-9b63-239a9e3830a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:36.634317 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3b0431f3-818f-4d90-9b63-239a9e3830a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:36.634743 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3b0431f3-818f-4d90-9b63-239a9e3830a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:36.635414 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3b0431f3-818f-4d90-9b63-239a9e3830a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:36.635902 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3b0431f3-818f-4d90-9b63-239a9e3830a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:36.636321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3b0431f3-818f-4d90-9b63-239a9e3830a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:36.700578 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-3b0431f3-818f-4d90-9b63-239a9e3830a3 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "POST /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/action" status: 202 len: 0 microversion: 2.1 time: 0.077692 Oct 27 17:36:36.701193 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 320/672] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Oct 27 17:36:36 2022] POST /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:36:36.709316 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-66c9dd06-db4b-44eb-80bd-4443cd8c61b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:36.710683 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-66c9dd06-db4b-44eb-80bd-4443cd8c61b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:36.717232 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-66c9dd06-db4b-44eb-80bd-4443cd8c61b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:36.717765 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-66c9dd06-db4b-44eb-80bd-4443cd8c61b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:36.718197 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-66c9dd06-db4b-44eb-80bd-4443cd8c61b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:36.718919 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-66c9dd06-db4b-44eb-80bd-4443cd8c61b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:36.719334 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-66c9dd06-db4b-44eb-80bd-4443cd8c61b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:36.719772 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-66c9dd06-db4b-44eb-80bd-4443cd8c61b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:36.937442 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-66c9dd06-db4b-44eb-80bd-4443cd8c61b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:36.945621 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-66c9dd06-db4b-44eb-80bd-4443cd8c61b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1722 microversion: 2.1 time: 0.240045 Oct 27 17:36:36.946190 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 353/673] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:36 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:37.027507 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-05c05d94-39e6-4f87-bff8-22ba1c2022bd tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:37.028261 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-05c05d94-39e6-4f87-bff8-22ba1c2022bd tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:37.034401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-05c05d94-39e6-4f87-bff8-22ba1c2022bd tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:37.034882 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-05c05d94-39e6-4f87-bff8-22ba1c2022bd tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:37.035318 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-05c05d94-39e6-4f87-bff8-22ba1c2022bd tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:37.036047 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-05c05d94-39e6-4f87-bff8-22ba1c2022bd tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:37.036499 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-05c05d94-39e6-4f87-bff8-22ba1c2022bd tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:37.036920 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-05c05d94-39e6-4f87-bff8-22ba1c2022bd tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:37.169162 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-05c05d94-39e6-4f87-bff8-22ba1c2022bd tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:37.172722 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:36:37.177687 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-05c05d94-39e6-4f87-bff8-22ba1c2022bd tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1676 microversion: 2.1 time: 0.155043 Oct 27 17:36:37.178263 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 321/674] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:37 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:37.969310 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-bb43be0c-eb08-40d0-944e-38dcf95bb13c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:37.969883 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-bb43be0c-eb08-40d0-944e-38dcf95bb13c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:37.976259 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bb43be0c-eb08-40d0-944e-38dcf95bb13c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:37.976994 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bb43be0c-eb08-40d0-944e-38dcf95bb13c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:37.977428 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bb43be0c-eb08-40d0-944e-38dcf95bb13c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:37.978113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bb43be0c-eb08-40d0-944e-38dcf95bb13c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:37.978565 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bb43be0c-eb08-40d0-944e-38dcf95bb13c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:37.978987 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bb43be0c-eb08-40d0-944e-38dcf95bb13c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:38.105086 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-bb43be0c-eb08-40d0-944e-38dcf95bb13c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:38.113631 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-bb43be0c-eb08-40d0-944e-38dcf95bb13c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1722 microversion: 2.1 time: 0.148345 Oct 27 17:36:38.114190 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 354/675] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:37 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:38.201063 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-5c355415-2cdd-4e91-81fd-3f3e71a84ac3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:38.201665 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-5c355415-2cdd-4e91-81fd-3f3e71a84ac3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:38.208700 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5c355415-2cdd-4e91-81fd-3f3e71a84ac3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:38.209212 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5c355415-2cdd-4e91-81fd-3f3e71a84ac3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:38.209645 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5c355415-2cdd-4e91-81fd-3f3e71a84ac3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:38.210334 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5c355415-2cdd-4e91-81fd-3f3e71a84ac3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:38.210781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5c355415-2cdd-4e91-81fd-3f3e71a84ac3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:38.211198 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5c355415-2cdd-4e91-81fd-3f3e71a84ac3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:38.336896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5c355415-2cdd-4e91-81fd-3f3e71a84ac3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:38.345038 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-5c355415-2cdd-4e91-81fd-3f3e71a84ac3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1676 microversion: 2.1 time: 0.148320 Oct 27 17:36:38.345601 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 322/676] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:38 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:39.137714 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5e7dd066-a73e-483c-a220-822cf231c739 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:39.138321 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-5e7dd066-a73e-483c-a220-822cf231c739 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:39.144701 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5e7dd066-a73e-483c-a220-822cf231c739 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:39.145209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5e7dd066-a73e-483c-a220-822cf231c739 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:39.145643 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5e7dd066-a73e-483c-a220-822cf231c739 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:39.146322 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5e7dd066-a73e-483c-a220-822cf231c739 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:39.146772 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5e7dd066-a73e-483c-a220-822cf231c739 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:39.147193 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5e7dd066-a73e-483c-a220-822cf231c739 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:39.275352 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-5e7dd066-a73e-483c-a220-822cf231c739 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:39.283415 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5e7dd066-a73e-483c-a220-822cf231c739 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1722 microversion: 2.1 time: 0.150165 Oct 27 17:36:39.284016 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 355/677] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:39 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:39.369190 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9a5c6648-db6b-4263-97a4-8d75344464b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:39.369734 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9a5c6648-db6b-4263-97a4-8d75344464b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:39.377031 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9a5c6648-db6b-4263-97a4-8d75344464b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:39.377511 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9a5c6648-db6b-4263-97a4-8d75344464b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:39.377943 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9a5c6648-db6b-4263-97a4-8d75344464b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:39.378624 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9a5c6648-db6b-4263-97a4-8d75344464b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:39.379072 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9a5c6648-db6b-4263-97a4-8d75344464b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:39.379490 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9a5c6648-db6b-4263-97a4-8d75344464b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:39.504635 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9a5c6648-db6b-4263-97a4-8d75344464b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:39.512192 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9a5c6648-db6b-4263-97a4-8d75344464b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1676 microversion: 2.1 time: 0.146962 Oct 27 17:36:39.512756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 323/678] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:39 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:40.306402 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-025d4fbe-d9b5-4e61-9e08-3fa7164ec7de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:40.307017 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-025d4fbe-d9b5-4e61-9e08-3fa7164ec7de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:40.313428 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-025d4fbe-d9b5-4e61-9e08-3fa7164ec7de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:40.313904 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-025d4fbe-d9b5-4e61-9e08-3fa7164ec7de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:40.314338 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-025d4fbe-d9b5-4e61-9e08-3fa7164ec7de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:40.315020 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-025d4fbe-d9b5-4e61-9e08-3fa7164ec7de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:40.315470 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-025d4fbe-d9b5-4e61-9e08-3fa7164ec7de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:40.315926 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-025d4fbe-d9b5-4e61-9e08-3fa7164ec7de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:40.441706 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-025d4fbe-d9b5-4e61-9e08-3fa7164ec7de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:40.449916 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-025d4fbe-d9b5-4e61-9e08-3fa7164ec7de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1722 microversion: 2.1 time: 0.147365 Oct 27 17:36:40.450473 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 356/679] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:40 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:40.534788 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b3e1f23d-0d03-482b-bd72-a79ff8977e5a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:40.535386 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b3e1f23d-0d03-482b-bd72-a79ff8977e5a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:40.542263 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3e1f23d-0d03-482b-bd72-a79ff8977e5a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:40.542777 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3e1f23d-0d03-482b-bd72-a79ff8977e5a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:40.543214 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3e1f23d-0d03-482b-bd72-a79ff8977e5a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:40.544023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3e1f23d-0d03-482b-bd72-a79ff8977e5a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:40.544477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3e1f23d-0d03-482b-bd72-a79ff8977e5a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:40.544896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3e1f23d-0d03-482b-bd72-a79ff8977e5a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:40.675676 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b3e1f23d-0d03-482b-bd72-a79ff8977e5a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:40.683350 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b3e1f23d-0d03-482b-bd72-a79ff8977e5a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1676 microversion: 2.1 time: 0.152377 Oct 27 17:36:40.683950 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 324/680] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:40 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:41.474936 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4f88d4a4-f898-4a1a-ac2a-040cf6a460ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:41.475484 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4f88d4a4-f898-4a1a-ac2a-040cf6a460ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:41.482320 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4f88d4a4-f898-4a1a-ac2a-040cf6a460ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:41.482805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4f88d4a4-f898-4a1a-ac2a-040cf6a460ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:41.483242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4f88d4a4-f898-4a1a-ac2a-040cf6a460ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:41.483966 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4f88d4a4-f898-4a1a-ac2a-040cf6a460ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:41.484425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4f88d4a4-f898-4a1a-ac2a-040cf6a460ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:41.484857 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4f88d4a4-f898-4a1a-ac2a-040cf6a460ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:41.488964 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:36:41.612872 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4f88d4a4-f898-4a1a-ac2a-040cf6a460ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:41.620959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4f88d4a4-f898-4a1a-ac2a-040cf6a460ab tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1728 microversion: 2.1 time: 0.150011 Oct 27 17:36:41.621521 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 357/681] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:41 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:41.643678 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-24a9e666-36bd-4fe8-8933-860f9c46ab38 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:41.644205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-24a9e666-36bd-4fe8-8933-860f9c46ab38 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:41.650452 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-24a9e666-36bd-4fe8-8933-860f9c46ab38 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:41.650923 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-24a9e666-36bd-4fe8-8933-860f9c46ab38 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:41.651350 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-24a9e666-36bd-4fe8-8933-860f9c46ab38 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:41.652046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-24a9e666-36bd-4fe8-8933-860f9c46ab38 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:41.652489 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-24a9e666-36bd-4fe8-8933-860f9c46ab38 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:41.652904 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-24a9e666-36bd-4fe8-8933-860f9c46ab38 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:41.706928 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-53827280-2873-445d-8e2c-1bb7b11a4ce4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:41.707544 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-53827280-2873-445d-8e2c-1bb7b11a4ce4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:41.713797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-53827280-2873-445d-8e2c-1bb7b11a4ce4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:41.714282 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-53827280-2873-445d-8e2c-1bb7b11a4ce4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:41.714716 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-53827280-2873-445d-8e2c-1bb7b11a4ce4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:41.715408 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-53827280-2873-445d-8e2c-1bb7b11a4ce4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:41.715901 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-53827280-2873-445d-8e2c-1bb7b11a4ce4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:41.716750 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-53827280-2873-445d-8e2c-1bb7b11a4ce4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:41.731001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-24a9e666-36bd-4fe8-8933-860f9c46ab38 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091698 Oct 27 17:36:41.731593 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 325/682] 10.222.0.36 () {58 vars in 1275 bytes} [Thu Oct 27 17:36:41 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:36:42.065838 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-53827280-2873-445d-8e2c-1bb7b11a4ce4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:42.073442 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-53827280-2873-445d-8e2c-1bb7b11a4ce4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1676 microversion: 2.1 time: 0.370431 Oct 27 17:36:42.074008 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 358/683] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:41 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1676 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:36:42.665888 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-07d408dc-b42a-40c1-a6cf-a3415d363dd5 req-c4e26b21-86ba-4140-b6a6-f0ca88269209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41584d40-839e-4610-9c2b-7291f0d8d790", "tag": "9f15684a-2e4a-47e6-b9f4-740131fbedfb"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:36:42.675411 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-07d408dc-b42a-40c1-a6cf-a3415d363dd5 req-c4e26b21-86ba-4140-b6a6-f0ca88269209 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:42.675928 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-07d408dc-b42a-40c1-a6cf-a3415d363dd5 req-c4e26b21-86ba-4140-b6a6-f0ca88269209 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:42.676358 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-07d408dc-b42a-40c1-a6cf-a3415d363dd5 req-c4e26b21-86ba-4140-b6a6-f0ca88269209 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:42.688133 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-07d408dc-b42a-40c1-a6cf-a3415d363dd5 req-c4e26b21-86ba-4140-b6a6-f0ca88269209 service nova] Creating event network-changed:9f15684a-2e4a-47e6-b9f4-740131fbedfb for instance 41584d40-839e-4610-9c2b-7291f0d8d790 on hv-cinder-86283 Oct 27 17:36:42.693110 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-07d408dc-b42a-40c1-a6cf-a3415d363dd5 req-c4e26b21-86ba-4140-b6a6-f0ca88269209 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084301 Oct 27 17:36:42.693878 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 326/684] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:36:43.097338 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-aff49adc-abef-44bb-a57f-203178cc2c49 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:43.098062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-aff49adc-abef-44bb-a57f-203178cc2c49 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:43.100531 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=35 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:36:43.106926 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aff49adc-abef-44bb-a57f-203178cc2c49 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:43.107417 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aff49adc-abef-44bb-a57f-203178cc2c49 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:43.107962 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aff49adc-abef-44bb-a57f-203178cc2c49 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:43.108699 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aff49adc-abef-44bb-a57f-203178cc2c49 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:43.109161 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aff49adc-abef-44bb-a57f-203178cc2c49 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:43.109592 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aff49adc-abef-44bb-a57f-203178cc2c49 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:43.314907 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-aff49adc-abef-44bb-a57f-203178cc2c49 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:43.322981 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-aff49adc-abef-44bb-a57f-203178cc2c49 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1676 microversion: 2.1 time: 0.230255 Oct 27 17:36:43.323678 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 359/685] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:43 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1676 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:44.350264 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-dfbf5c9e-4e13-4596-b776-9c0acb90c7ce tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:44.350962 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-dfbf5c9e-4e13-4596-b776-9c0acb90c7ce tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:44.357342 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dfbf5c9e-4e13-4596-b776-9c0acb90c7ce tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:44.357823 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dfbf5c9e-4e13-4596-b776-9c0acb90c7ce tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:44.358824 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dfbf5c9e-4e13-4596-b776-9c0acb90c7ce tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:44.359512 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dfbf5c9e-4e13-4596-b776-9c0acb90c7ce tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:44.359993 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dfbf5c9e-4e13-4596-b776-9c0acb90c7ce tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:44.360418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dfbf5c9e-4e13-4596-b776-9c0acb90c7ce tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:44.492338 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-dfbf5c9e-4e13-4596-b776-9c0acb90c7ce tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:44.499942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-dfbf5c9e-4e13-4596-b776-9c0acb90c7ce tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1676 microversion: 2.1 time: 0.154337 Oct 27 17:36:44.500506 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 327/686] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:44 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:44.707876 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-311b0f5d-073b-437d-a6c2-214e1d45c717 req-226fe472-e53d-4a62-9139-a7e388208818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41584d40-839e-4610-9c2b-7291f0d8d790", "tag": "9f15684a-2e4a-47e6-b9f4-740131fbedfb"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:36:44.718151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-311b0f5d-073b-437d-a6c2-214e1d45c717 req-226fe472-e53d-4a62-9139-a7e388208818 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:44.718634 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-311b0f5d-073b-437d-a6c2-214e1d45c717 req-226fe472-e53d-4a62-9139-a7e388208818 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:44.719062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-311b0f5d-073b-437d-a6c2-214e1d45c717 req-226fe472-e53d-4a62-9139-a7e388208818 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:44.729879 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-311b0f5d-073b-437d-a6c2-214e1d45c717 req-226fe472-e53d-4a62-9139-a7e388208818 service nova] Creating event network-changed:9f15684a-2e4a-47e6-b9f4-740131fbedfb for instance 41584d40-839e-4610-9c2b-7291f0d8d790 on hv-cinder-86283 Oct 27 17:36:44.734753 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-311b0f5d-073b-437d-a6c2-214e1d45c717 req-226fe472-e53d-4a62-9139-a7e388208818 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030534 Oct 27 17:36:44.735332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 360/687] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:36:45.523340 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b92f325b-1d9d-4ee7-9963-883a0677b094 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:45.523990 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b92f325b-1d9d-4ee7-9963-883a0677b094 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:45.530477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b92f325b-1d9d-4ee7-9963-883a0677b094 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:45.530932 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b92f325b-1d9d-4ee7-9963-883a0677b094 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:45.531373 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b92f325b-1d9d-4ee7-9963-883a0677b094 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:45.532107 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b92f325b-1d9d-4ee7-9963-883a0677b094 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:45.532559 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b92f325b-1d9d-4ee7-9963-883a0677b094 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:45.532981 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b92f325b-1d9d-4ee7-9963-883a0677b094 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:45.659685 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b92f325b-1d9d-4ee7-9963-883a0677b094 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:45.667229 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b92f325b-1d9d-4ee7-9963-883a0677b094 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1676 microversion: 2.1 time: 0.147754 Oct 27 17:36:45.667812 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 328/688] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:45 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:46.692233 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-3cab7002-b31a-40d4-b226-de4379509137 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:46.692951 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-3cab7002-b31a-40d4-b226-de4379509137 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:46.698981 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3cab7002-b31a-40d4-b226-de4379509137 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:46.699457 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3cab7002-b31a-40d4-b226-de4379509137 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:46.699915 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3cab7002-b31a-40d4-b226-de4379509137 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:46.700594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3cab7002-b31a-40d4-b226-de4379509137 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:46.701042 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3cab7002-b31a-40d4-b226-de4379509137 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:46.701457 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3cab7002-b31a-40d4-b226-de4379509137 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:46.834507 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-3cab7002-b31a-40d4-b226-de4379509137 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:46.842449 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-3cab7002-b31a-40d4-b226-de4379509137 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1676 microversion: 2.1 time: 0.154877 Oct 27 17:36:46.843010 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 361/689] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:46 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:47.866607 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3ff4ca29-1cf9-436e-a9a6-924bbb85eb9d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:47.867167 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-3ff4ca29-1cf9-436e-a9a6-924bbb85eb9d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:47.873636 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3ff4ca29-1cf9-436e-a9a6-924bbb85eb9d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:47.874110 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3ff4ca29-1cf9-436e-a9a6-924bbb85eb9d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:47.874540 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3ff4ca29-1cf9-436e-a9a6-924bbb85eb9d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:47.875217 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3ff4ca29-1cf9-436e-a9a6-924bbb85eb9d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:47.875665 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3ff4ca29-1cf9-436e-a9a6-924bbb85eb9d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:47.876127 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3ff4ca29-1cf9-436e-a9a6-924bbb85eb9d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:47.999653 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-3ff4ca29-1cf9-436e-a9a6-924bbb85eb9d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:48.007577 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-3ff4ca29-1cf9-436e-a9a6-924bbb85eb9d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1676 microversion: 2.1 time: 0.144965 Oct 27 17:36:48.008200 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 329/690] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:47 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:49.030573 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-e38c2b46-ccd4-4919-bd8f-78cf9422a4c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:49.031177 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e38c2b46-ccd4-4919-bd8f-78cf9422a4c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:49.037502 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e38c2b46-ccd4-4919-bd8f-78cf9422a4c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:49.037978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e38c2b46-ccd4-4919-bd8f-78cf9422a4c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:49.038410 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e38c2b46-ccd4-4919-bd8f-78cf9422a4c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:49.039089 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e38c2b46-ccd4-4919-bd8f-78cf9422a4c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:49.039532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e38c2b46-ccd4-4919-bd8f-78cf9422a4c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:49.039969 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e38c2b46-ccd4-4919-bd8f-78cf9422a4c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:49.164910 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e38c2b46-ccd4-4919-bd8f-78cf9422a4c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:49.173071 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-e38c2b46-ccd4-4919-bd8f-78cf9422a4c0 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1676 microversion: 2.1 time: 0.146481 Oct 27 17:36:49.173652 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 362/691] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:49 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:50.196496 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-900a967b-e103-4d11-a453-334ffecd946a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:50.197103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-900a967b-e103-4d11-a453-334ffecd946a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:50.199553 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=41 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:36:50.205323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-900a967b-e103-4d11-a453-334ffecd946a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:50.205799 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-900a967b-e103-4d11-a453-334ffecd946a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:50.206228 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-900a967b-e103-4d11-a453-334ffecd946a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:50.206906 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-900a967b-e103-4d11-a453-334ffecd946a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:50.207352 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-900a967b-e103-4d11-a453-334ffecd946a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:50.207795 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-900a967b-e103-4d11-a453-334ffecd946a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:50.335383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-900a967b-e103-4d11-a453-334ffecd946a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:50.343630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-900a967b-e103-4d11-a453-334ffecd946a tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1676 microversion: 2.1 time: 0.150946 Oct 27 17:36:50.344225 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 330/692] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:50 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:51.366833 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-506caf9d-6361-43f2-a8a4-1e307ec7ce01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:51.367435 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-506caf9d-6361-43f2-a8a4-1e307ec7ce01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:51.374503 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-506caf9d-6361-43f2-a8a4-1e307ec7ce01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:51.374974 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-506caf9d-6361-43f2-a8a4-1e307ec7ce01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:51.375426 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-506caf9d-6361-43f2-a8a4-1e307ec7ce01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:51.376143 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-506caf9d-6361-43f2-a8a4-1e307ec7ce01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:51.376588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-506caf9d-6361-43f2-a8a4-1e307ec7ce01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:51.377002 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-506caf9d-6361-43f2-a8a4-1e307ec7ce01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:51.509545 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-506caf9d-6361-43f2-a8a4-1e307ec7ce01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:51.517297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-506caf9d-6361-43f2-a8a4-1e307ec7ce01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1676 microversion: 2.1 time: 0.154404 Oct 27 17:36:51.517858 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 363/693] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:51 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:52.539909 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-45fc779d-3bf3-4549-9764-d0516f7bfa74 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:52.540520 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-45fc779d-3bf3-4549-9764-d0516f7bfa74 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:52.547620 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-45fc779d-3bf3-4549-9764-d0516f7bfa74 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:52.548178 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-45fc779d-3bf3-4549-9764-d0516f7bfa74 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:52.548617 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-45fc779d-3bf3-4549-9764-d0516f7bfa74 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:52.549302 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-45fc779d-3bf3-4549-9764-d0516f7bfa74 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:52.549759 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-45fc779d-3bf3-4549-9764-d0516f7bfa74 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:52.550174 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-45fc779d-3bf3-4549-9764-d0516f7bfa74 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:52.676746 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-45fc779d-3bf3-4549-9764-d0516f7bfa74 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:52.684280 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-45fc779d-3bf3-4549-9764-d0516f7bfa74 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1653 microversion: 2.1 time: 0.148219 Oct 27 17:36:52.684849 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 331/694] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:52 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1653 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:52.707424 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5d5cb970-947e-4505-8baa-7f497ac68747 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:36:52.713999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5d5cb970-947e-4505-8baa-7f497ac68747 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:52.714423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5d5cb970-947e-4505-8baa-7f497ac68747 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:52.714859 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5d5cb970-947e-4505-8baa-7f497ac68747 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:52.737398 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-5d5cb970-947e-4505-8baa-7f497ac68747 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Going to try to start instance {{(pid=119047) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 17:36:52.777866 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5d5cb970-947e-4505-8baa-7f497ac68747 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "POST /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/action" status: 202 len: 0 microversion: 2.1 time: 0.074170 Oct 27 17:36:52.778482 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 364/695] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Oct 27 17:36:52 2022] POST /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:36:52.786932 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d0a1745d-2752-41bf-a49b-31100ee7d51c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:52.788191 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d0a1745d-2752-41bf-a49b-31100ee7d51c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:52.794337 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d0a1745d-2752-41bf-a49b-31100ee7d51c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:52.794816 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d0a1745d-2752-41bf-a49b-31100ee7d51c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:52.795237 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d0a1745d-2752-41bf-a49b-31100ee7d51c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:52.795980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d0a1745d-2752-41bf-a49b-31100ee7d51c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:52.796424 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d0a1745d-2752-41bf-a49b-31100ee7d51c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:52.796839 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d0a1745d-2752-41bf-a49b-31100ee7d51c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:52.933453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d0a1745d-2752-41bf-a49b-31100ee7d51c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:52.941204 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d0a1745d-2752-41bf-a49b-31100ee7d51c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1662 microversion: 2.1 time: 0.158010 Oct 27 17:36:52.941778 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 332/696] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:52 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:53.966255 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-e89be606-04a6-421e-bc59-d7266442b50f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:53.966862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e89be606-04a6-421e-bc59-d7266442b50f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:53.973533 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e89be606-04a6-421e-bc59-d7266442b50f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:53.974010 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e89be606-04a6-421e-bc59-d7266442b50f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:53.974445 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e89be606-04a6-421e-bc59-d7266442b50f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:53.975130 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e89be606-04a6-421e-bc59-d7266442b50f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:53.975582 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e89be606-04a6-421e-bc59-d7266442b50f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:53.976287 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e89be606-04a6-421e-bc59-d7266442b50f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:54.109232 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e89be606-04a6-421e-bc59-d7266442b50f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:54.116932 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-e89be606-04a6-421e-bc59-d7266442b50f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1662 microversion: 2.1 time: 0.155174 Oct 27 17:36:54.117492 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 365/697] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:53 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:55.140299 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-23d0aeb5-c94d-4bfa-b9f1-540d8dfd959e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:55.140900 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-23d0aeb5-c94d-4bfa-b9f1-540d8dfd959e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:55.147234 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-23d0aeb5-c94d-4bfa-b9f1-540d8dfd959e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:55.147729 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-23d0aeb5-c94d-4bfa-b9f1-540d8dfd959e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:55.148168 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-23d0aeb5-c94d-4bfa-b9f1-540d8dfd959e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:55.148846 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-23d0aeb5-c94d-4bfa-b9f1-540d8dfd959e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:55.149294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-23d0aeb5-c94d-4bfa-b9f1-540d8dfd959e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:55.149712 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-23d0aeb5-c94d-4bfa-b9f1-540d8dfd959e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:55.275391 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-23d0aeb5-c94d-4bfa-b9f1-540d8dfd959e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:55.283596 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-23d0aeb5-c94d-4bfa-b9f1-540d8dfd959e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1666 microversion: 2.1 time: 0.147098 Oct 27 17:36:55.284195 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 333/698] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:55 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1666 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:55.457489 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2e333d94-1e64-4b9e-b3bc-b6b499e31016 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:55.457989 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2e333d94-1e64-4b9e-b3bc-b6b499e31016 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:55.464537 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e333d94-1e64-4b9e-b3bc-b6b499e31016 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:55.465141 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e333d94-1e64-4b9e-b3bc-b6b499e31016 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:55.465581 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e333d94-1e64-4b9e-b3bc-b6b499e31016 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:55.466327 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e333d94-1e64-4b9e-b3bc-b6b499e31016 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:55.466785 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e333d94-1e64-4b9e-b3bc-b6b499e31016 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:55.467213 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2e333d94-1e64-4b9e-b3bc-b6b499e31016 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:55.491564 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2e333d94-1e64-4b9e-b3bc-b6b499e31016 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a/ips" status: 200 len: 151 microversion: 2.1 time: 0.087547 Oct 27 17:36:55.492151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 366/699] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Oct 27 17:36:55 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a/ips => generated 151 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:36:55.503840 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9f0c8893-aff8-4371-ac07-ba10627edb86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96b328e6-8e5f-48de-9de7-381ccfee4804"}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:36:55.506256 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9f0c8893-aff8-4371-ac07-ba10627edb86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:55.512145 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f0c8893-aff8-4371-ac07-ba10627edb86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:55.512628 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f0c8893-aff8-4371-ac07-ba10627edb86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:55.513063 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f0c8893-aff8-4371-ac07-ba10627edb86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:55.513748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f0c8893-aff8-4371-ac07-ba10627edb86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:55.514210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f0c8893-aff8-4371-ac07-ba10627edb86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:55.514636 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9f0c8893-aff8-4371-ac07-ba10627edb86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:55.592071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-9f0c8893-aff8-4371-ac07-ba10627edb86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] HTTP exception thrown: Invalid volume: volume 96b328e6-8e5f-48de-9de7-381ccfee4804 is already attached to instances: 13686e3e-dfd4-4f2e-9781-92321ff85702 Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9f0c8893-aff8-4371-ac07-ba10627edb86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Request method failure captured: Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: POST /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a/os-volume_attachments HTTP/1.1 Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 74 Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA48P867QnVFetJM_7-4A7Zzy1y_BgK92PPcM5QN2sMM7rFRhLUgPfG-i71JivsPG4LadkJJ4XcZlaVkMTt9ACmFBCVr55uoiFNCoOee5ZYSDumbUSBNjRpORNBa4HVT1DYjC6OvQXdJDtZsCkYaDUqFgRE6zbJPygnGePlokMgMzQ Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:36:55.594368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:36:55.596046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}] Oct 27 17:36:55.596046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:36:55.596046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:36:55.596046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:36:55.596046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:36:55.596046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:36:55.596046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:36:55.596046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 3c36ea3a53cc48fa996891e3c6ddfda8 Oct 27 17:36:55.596046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:36:55.596046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Oct 27 17:36:55.596046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {"volumeAttachment": {"volumeId": "96b328e6-8e5f-48de-9de7-381ccfee4804"}} Oct 27 17:36:55.596046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Invalid volume: volume 96b328e6-8e5f-48de-9de7-381ccfee4804 is already attached to instances: 13686e3e-dfd4-4f2e-9781-92321ff85702 Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'server_id': '50b532a6-30c9-44d5-b680-2e6bc6b2c41a', 'body': {'volumeAttachment': {'volumeId': '96b328e6-8e5f-48de-9de7-381ccfee4804'}}} Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 96b328e6-8e5f-48de-9de7-381ccfee4804 is already attached to instances: 13686e3e-dfd4-4f2e-9781-92321ff85702 Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:36:55.598219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 96b328e6-8e5f-48de-9de7-381ccfee4804 is already attached to instances: 13686e3e-dfd4-4f2e-9781-92321ff85702 Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:36:55.599477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:36:55.600865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:36:55.600865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:36:55.600865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:36:55.600865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 96b328e6-8e5f-48de-9de7-381ccfee4804 is already attached to instances: 13686e3e-dfd4-4f2e-9781-92321ff85702 Oct 27 17:36:55.600865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:36:55.600865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9f0c8893-aff8-4371-ac07-ba10627edb86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Returning 400 to user: Invalid volume: volume 96b328e6-8e5f-48de-9de7-381ccfee4804 is already attached to instances: 13686e3e-dfd4-4f2e-9781-92321ff85702 {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:36:55.600865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9f0c8893-aff8-4371-ac07-ba10627edb86 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "POST /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096008 Oct 27 17:36:55.600865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 334/700] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Oct 27 17:36:55 2022] POST /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 17:36:55.605007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b8de5eeb-d55d-4fbe-82b1-bbbd4e932b32 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:55.605506 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b8de5eeb-d55d-4fbe-82b1-bbbd4e932b32 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:55.612349 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b8de5eeb-d55d-4fbe-82b1-bbbd4e932b32 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:55.612837 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b8de5eeb-d55d-4fbe-82b1-bbbd4e932b32 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:55.613276 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b8de5eeb-d55d-4fbe-82b1-bbbd4e932b32 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:55.613961 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b8de5eeb-d55d-4fbe-82b1-bbbd4e932b32 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:55.614414 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b8de5eeb-d55d-4fbe-82b1-bbbd4e932b32 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:55.614838 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b8de5eeb-d55d-4fbe-82b1-bbbd4e932b32 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:55.639119 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b8de5eeb-d55d-4fbe-82b1-bbbd4e932b32 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Going to try to terminate instance {{(pid=119047) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:36:55.723272 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b8de5eeb-d55d-4fbe-82b1-bbbd4e932b32 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "DELETE /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 204 len: 0 microversion: 2.1 time: 0.122015 Oct 27 17:36:55.723790 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 367/701] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:36:55 2022] DELETE /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:36:55.732189 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d5058e56-ac6f-43dc-ac03-40e869873187 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:55.732806 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d5058e56-ac6f-43dc-ac03-40e869873187 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:55.739903 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5058e56-ac6f-43dc-ac03-40e869873187 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:55.740388 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5058e56-ac6f-43dc-ac03-40e869873187 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:55.740821 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5058e56-ac6f-43dc-ac03-40e869873187 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:55.741538 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5058e56-ac6f-43dc-ac03-40e869873187 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:55.741993 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5058e56-ac6f-43dc-ac03-40e869873187 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:55.742417 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5058e56-ac6f-43dc-ac03-40e869873187 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:55.867467 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d5058e56-ac6f-43dc-ac03-40e869873187 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:55.875124 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d5058e56-ac6f-43dc-ac03-40e869873187 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1682 microversion: 2.1 time: 0.146875 Oct 27 17:36:55.875685 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 335/702] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:55 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:56.899666 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4b09dbdb-2a1a-4622-b452-71a912a9f1a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:56.900311 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4b09dbdb-2a1a-4622-b452-71a912a9f1a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:56.906744 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4b09dbdb-2a1a-4622-b452-71a912a9f1a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:56.907224 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4b09dbdb-2a1a-4622-b452-71a912a9f1a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:56.907655 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4b09dbdb-2a1a-4622-b452-71a912a9f1a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:56.908365 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4b09dbdb-2a1a-4622-b452-71a912a9f1a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:56.908812 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4b09dbdb-2a1a-4622-b452-71a912a9f1a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:56.909231 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4b09dbdb-2a1a-4622-b452-71a912a9f1a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:57.036008 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4b09dbdb-2a1a-4622-b452-71a912a9f1a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:57.043575 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4b09dbdb-2a1a-4622-b452-71a912a9f1a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1682 microversion: 2.1 time: 0.148396 Oct 27 17:36:57.044167 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 368/703] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:56 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:58.068273 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8b268dee-a5ab-45b0-bde5-73a8fb1e6b65 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:58.069131 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8b268dee-a5ab-45b0-bde5-73a8fb1e6b65 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:58.076029 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b268dee-a5ab-45b0-bde5-73a8fb1e6b65 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:58.076581 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b268dee-a5ab-45b0-bde5-73a8fb1e6b65 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:58.077019 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b268dee-a5ab-45b0-bde5-73a8fb1e6b65 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:58.078240 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b268dee-a5ab-45b0-bde5-73a8fb1e6b65 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:58.078905 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b268dee-a5ab-45b0-bde5-73a8fb1e6b65 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:58.079110 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b268dee-a5ab-45b0-bde5-73a8fb1e6b65 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:58.209327 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8b268dee-a5ab-45b0-bde5-73a8fb1e6b65 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:58.217059 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8b268dee-a5ab-45b0-bde5-73a8fb1e6b65 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1682 microversion: 2.1 time: 0.154546 Oct 27 17:36:58.217625 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 336/704] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:58 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:36:59.005157 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-499ca4aa-4049-46d5-b41e-1608500171df req-bb81198d-1caa-4d92-8880-f40cf726a16f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50b532a6-30c9-44d5-b680-2e6bc6b2c41a", "name": "network-vif-deleted", "tag": "e8441a6d-549a-4734-aaa6-21d018ed2a33"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:36:59.016454 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-499ca4aa-4049-46d5-b41e-1608500171df req-bb81198d-1caa-4d92-8880-f40cf726a16f service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:59.016935 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-499ca4aa-4049-46d5-b41e-1608500171df req-bb81198d-1caa-4d92-8880-f40cf726a16f service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:59.017435 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-499ca4aa-4049-46d5-b41e-1608500171df req-bb81198d-1caa-4d92-8880-f40cf726a16f service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:59.028678 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-499ca4aa-4049-46d5-b41e-1608500171df req-bb81198d-1caa-4d92-8880-f40cf726a16f service nova] Creating event network-vif-deleted:e8441a6d-549a-4734-aaa6-21d018ed2a33 for instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a on hv-cinder-86283 Oct 27 17:36:59.035081 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-499ca4aa-4049-46d5-b41e-1608500171df req-bb81198d-1caa-4d92-8880-f40cf726a16f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094373 Oct 27 17:36:59.035969 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 369/705] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:36:59.242664 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6fe3b2a3-2400-4840-80b6-0853b5dc4262 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:36:59.243364 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6fe3b2a3-2400-4840-80b6-0853b5dc4262 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:36:59.250233 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6fe3b2a3-2400-4840-80b6-0853b5dc4262 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:59.250911 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6fe3b2a3-2400-4840-80b6-0853b5dc4262 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:59.251488 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6fe3b2a3-2400-4840-80b6-0853b5dc4262 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:59.252418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6fe3b2a3-2400-4840-80b6-0853b5dc4262 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:59.253019 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6fe3b2a3-2400-4840-80b6-0853b5dc4262 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:59.253584 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6fe3b2a3-2400-4840-80b6-0853b5dc4262 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:59.293321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6fe3b2a3-2400-4840-80b6-0853b5dc4262 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:36:59.293877 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6fe3b2a3-2400-4840-80b6-0853b5dc4262 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:36:59.294375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6fe3b2a3-2400-4840-80b6-0853b5dc4262 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:36:59.294826 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-6fe3b2a3-2400-4840-80b6-0853b5dc4262 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lazy-loading 'fault' on Instance uuid 50b532a6-30c9-44d5-b680-2e6bc6b2c41a {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:36:59.346749 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-6fe3b2a3-2400-4840-80b6-0853b5dc4262 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:36:59.357770 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6fe3b2a3-2400-4840-80b6-0853b5dc4262 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 200 len: 1330 microversion: 2.1 time: 0.120062 Oct 27 17:36:59.363994 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 337/706] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:36:59 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 1330 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:00.386434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0d0b625c-7432-43a5-ac8f-22596a983710 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:00.387119 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-0d0b625c-7432-43a5-ac8f-22596a983710 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:00.393770 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0d0b625c-7432-43a5-ac8f-22596a983710 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:00.394267 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0d0b625c-7432-43a5-ac8f-22596a983710 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:00.394696 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0d0b625c-7432-43a5-ac8f-22596a983710 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:00.395413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0d0b625c-7432-43a5-ac8f-22596a983710 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:00.395924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0d0b625c-7432-43a5-ac8f-22596a983710 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:00.396345 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0d0b625c-7432-43a5-ac8f-22596a983710 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:00.409466 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-0d0b625c-7432-43a5-ac8f-22596a983710 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] HTTP exception thrown: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0d0b625c-7432-43a5-ac8f-22596a983710 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Request method failure captured: Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a HTTP/1.1 Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA48P867QnVFetJM_7-4A7Zzy1y_BgK92PPcM5QN2sMM7rFRhLUgPfG-i71JivsPG4LadkJJ4XcZlaVkMTt9ACmFBCVr55uoiFNCoOee5ZYSDumbUSBNjRpORNBa4HVT1DYjC6OvQXdJDtZsCkYaDUqFgRE6zbJPygnGePlokMgMzQ Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:37:00.411066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:37:00.412620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}] Oct 27 17:37:00.412620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:37:00.412620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:37:00.412620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:37:00.412620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:37:00.412620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:37:00.412620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:37:00.412620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 3c36ea3a53cc48fa996891e3c6ddfda8 Oct 27 17:37:00.412620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:37:00.412620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:37:00.412620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. Oct 27 17:37:00.412620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': '50b532a6-30c9-44d5-b680-2e6bc6b2c41a'} Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:37:00.413425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. Oct 27 17:37:00.414855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:00.416175 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0d0b625c-7432-43a5-ac8f-22596a983710 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Returning 404 to user: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:37:00.416175 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0d0b625c-7432-43a5-ac8f-22596a983710 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 404 len: 111 microversion: 2.1 time: 0.030246 Oct 27 17:37:00.416175 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 370/707] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:00 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:37:00.421651 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-829c4a59-dca9-4eaa-95a7-dc927e82bcd7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '.version_select at 0x7f0788664550>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:00.426156 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR oslo.messaging._drivers.impl_rabbit [None req-829c4a59-dca9-4eaa-95a7-dc927e82bcd7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [841c259c-4904-409c-ba34-a7f3f847f473] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 17:37:01.435270 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO oslo.messaging._drivers.impl_rabbit [None req-829c4a59-dca9-4eaa-95a7-dc927e82bcd7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [841c259c-4904-409c-ba34-a7f3f847f473] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 48854. Oct 27 17:37:01.454898 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-829c4a59-dca9-4eaa-95a7-dc927e82bcd7 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-481389143" status: 202 len: 0 microversion: 2.1 time: 1.037470 Oct 27 17:37:01.455468 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 338/708] 10.222.0.36 () {58 vars in 1218 bytes} [Thu Oct 27 17:37:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-481389143 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:37:02.121454 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-7c0a529a-11ba-460a-8614-004464884de2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:02.121954 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-7c0a529a-11ba-460a-8614-004464884de2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:02.128328 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7c0a529a-11ba-460a-8614-004464884de2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:02.128804 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7c0a529a-11ba-460a-8614-004464884de2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:02.129241 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7c0a529a-11ba-460a-8614-004464884de2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:02.129922 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7c0a529a-11ba-460a-8614-004464884de2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:02.130374 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7c0a529a-11ba-460a-8614-004464884de2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:02.130794 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7c0a529a-11ba-460a-8614-004464884de2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:02.208913 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.objects.instance [None req-7c0a529a-11ba-460a-8614-004464884de2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lazy-loading 'services' on Instance uuid 13686e3e-dfd4-4f2e-9781-92321ff85702 {{(pid=119047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:37:02.318223 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-7c0a529a-11ba-460a-8614-004464884de2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "DELETE /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702/os-volume_attachments/96b328e6-8e5f-48de-9de7-381ccfee4804" status: 202 len: 0 microversion: 2.1 time: 0.200464 Oct 27 17:37:02.318801 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 371/709] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Oct 27 17:37:02 2022] DELETE /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702/os-volume_attachments/96b328e6-8e5f-48de-9de7-381ccfee4804 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:37:02.327183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-af6a0057-9591-4d7e-b583-8b48a8a6c19c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:02.329436 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-af6a0057-9591-4d7e-b583-8b48a8a6c19c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:02.335353 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-af6a0057-9591-4d7e-b583-8b48a8a6c19c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:02.336053 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-af6a0057-9591-4d7e-b583-8b48a8a6c19c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:02.336560 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-af6a0057-9591-4d7e-b583-8b48a8a6c19c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:02.337361 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-af6a0057-9591-4d7e-b583-8b48a8a6c19c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:02.337843 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-af6a0057-9591-4d7e-b583-8b48a8a6c19c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:02.338593 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-af6a0057-9591-4d7e-b583-8b48a8a6c19c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:02.369426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-af6a0057-9591-4d7e-b583-8b48a8a6c19c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046227 Oct 27 17:37:02.369979 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 339/710] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:37:02 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:03.383012 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-28dc8343-7801-418e-ba2d-3f2907402253 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:03.385321 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-28dc8343-7801-418e-ba2d-3f2907402253 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:03.391412 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-28dc8343-7801-418e-ba2d-3f2907402253 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:03.391927 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-28dc8343-7801-418e-ba2d-3f2907402253 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:03.392357 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-28dc8343-7801-418e-ba2d-3f2907402253 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:03.393036 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-28dc8343-7801-418e-ba2d-3f2907402253 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:03.393487 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-28dc8343-7801-418e-ba2d-3f2907402253 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:03.393901 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-28dc8343-7801-418e-ba2d-3f2907402253 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:03.419110 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:37:03.424803 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-28dc8343-7801-418e-ba2d-3f2907402253 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046629 Oct 27 17:37:03.425349 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 372/711] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:37:03 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:04.437624 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-57ef56f5-4729-4dbf-8f1d-02439490b82e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:04.439839 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-57ef56f5-4729-4dbf-8f1d-02439490b82e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:04.446510 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-57ef56f5-4729-4dbf-8f1d-02439490b82e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:04.446980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-57ef56f5-4729-4dbf-8f1d-02439490b82e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:04.447406 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-57ef56f5-4729-4dbf-8f1d-02439490b82e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:04.448212 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-57ef56f5-4729-4dbf-8f1d-02439490b82e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:04.448698 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-57ef56f5-4729-4dbf-8f1d-02439490b82e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:04.449129 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-57ef56f5-4729-4dbf-8f1d-02439490b82e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:04.453350 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=100 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:37:04.480375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-57ef56f5-4729-4dbf-8f1d-02439490b82e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047157 Oct 27 17:37:04.480922 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 340/712] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:37:04 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 17:37:04.543725 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-226d5b24-158f-45bb-9828-682d41925562 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:04.544281 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-226d5b24-158f-45bb-9828-682d41925562 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:04.551652 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-226d5b24-158f-45bb-9828-682d41925562 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:04.552164 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-226d5b24-158f-45bb-9828-682d41925562 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:04.552659 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-226d5b24-158f-45bb-9828-682d41925562 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:04.553358 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-226d5b24-158f-45bb-9828-682d41925562 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:04.553809 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-226d5b24-158f-45bb-9828-682d41925562 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:04.554231 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-226d5b24-158f-45bb-9828-682d41925562 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:04.583121 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-226d5b24-158f-45bb-9828-682d41925562 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Going to try to terminate instance {{(pid=119047) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:37:04.660049 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-226d5b24-158f-45bb-9828-682d41925562 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "DELETE /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 204 len: 0 microversion: 2.1 time: 0.119274 Oct 27 17:37:04.660673 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 373/713] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:37:04 2022] DELETE /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:37:04.668955 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-781f9540-215d-4f3b-911d-d261db0e2239 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:04.669561 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-781f9540-215d-4f3b-911d-d261db0e2239 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:04.676642 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-781f9540-215d-4f3b-911d-d261db0e2239 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:04.677127 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-781f9540-215d-4f3b-911d-d261db0e2239 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:04.677566 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-781f9540-215d-4f3b-911d-d261db0e2239 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:04.678258 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-781f9540-215d-4f3b-911d-d261db0e2239 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:04.678709 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-781f9540-215d-4f3b-911d-d261db0e2239 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:04.679167 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-781f9540-215d-4f3b-911d-d261db0e2239 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:04.810282 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-781f9540-215d-4f3b-911d-d261db0e2239 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:04.818490 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-781f9540-215d-4f3b-911d-d261db0e2239 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1681 microversion: 2.1 time: 0.153347 Oct 27 17:37:04.819054 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 341/714] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:04 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:05.842435 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6be0c9af-6bb4-4a52-9341-267a07d79959 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:05.843657 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-6be0c9af-6bb4-4a52-9341-267a07d79959 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:05.850145 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6be0c9af-6bb4-4a52-9341-267a07d79959 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:05.850623 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6be0c9af-6bb4-4a52-9341-267a07d79959 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:05.851536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6be0c9af-6bb4-4a52-9341-267a07d79959 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:05.852323 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6be0c9af-6bb4-4a52-9341-267a07d79959 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:05.852778 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6be0c9af-6bb4-4a52-9341-267a07d79959 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:05.853197 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6be0c9af-6bb4-4a52-9341-267a07d79959 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:06.057092 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-6be0c9af-6bb4-4a52-9341-267a07d79959 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:06.064734 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6be0c9af-6bb4-4a52-9341-267a07d79959 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1681 microversion: 2.1 time: 0.226461 Oct 27 17:37:06.065297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 374/715] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:05 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1681 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:37:06.938874 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-5fb8fc2a-b598-4314-bdf9-75479b4db801 req-f88b7e24-9baf-4629-8de7-bcf8b81e3556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13686e3e-dfd4-4f2e-9781-92321ff85702", "name": "network-vif-deleted", "tag": "021b0623-ac50-4080-925e-8bf3d47884b1"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:06.949066 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-5fb8fc2a-b598-4314-bdf9-75479b4db801 req-f88b7e24-9baf-4629-8de7-bcf8b81e3556 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:06.949589 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-5fb8fc2a-b598-4314-bdf9-75479b4db801 req-f88b7e24-9baf-4629-8de7-bcf8b81e3556 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:06.950006 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-5fb8fc2a-b598-4314-bdf9-75479b4db801 req-f88b7e24-9baf-4629-8de7-bcf8b81e3556 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:06.961670 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-5fb8fc2a-b598-4314-bdf9-75479b4db801 req-f88b7e24-9baf-4629-8de7-bcf8b81e3556 service nova] Creating event network-vif-deleted:021b0623-ac50-4080-925e-8bf3d47884b1 for instance 13686e3e-dfd4-4f2e-9781-92321ff85702 on hv-cinder-86283 Oct 27 17:37:06.967460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-5fb8fc2a-b598-4314-bdf9-75479b4db801 req-f88b7e24-9baf-4629-8de7-bcf8b81e3556 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032704 Oct 27 17:37:06.968543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 342/716] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:07.069138 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-abaf5e4e-f3a7-402c-aa9a-b3edcae36fc2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:07.070751 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-abaf5e4e-f3a7-402c-aa9a-b3edcae36fc2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:07.078350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-abaf5e4e-f3a7-402c-aa9a-b3edcae36fc2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:07.078930 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-abaf5e4e-f3a7-402c-aa9a-b3edcae36fc2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:07.079459 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-abaf5e4e-f3a7-402c-aa9a-b3edcae36fc2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:07.080324 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-abaf5e4e-f3a7-402c-aa9a-b3edcae36fc2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:07.080836 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-abaf5e4e-f3a7-402c-aa9a-b3edcae36fc2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:07.082756 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-abaf5e4e-f3a7-402c-aa9a-b3edcae36fc2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:07.088477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-c52ab72f-479f-4f05-8b23-ebc61d2a3237 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:07.089188 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c52ab72f-479f-4f05-8b23-ebc61d2a3237 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:07.103425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c52ab72f-479f-4f05-8b23-ebc61d2a3237 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:07.104082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c52ab72f-479f-4f05-8b23-ebc61d2a3237 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:07.104400 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c52ab72f-479f-4f05-8b23-ebc61d2a3237 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:07.105094 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c52ab72f-479f-4f05-8b23-ebc61d2a3237 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:07.105547 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c52ab72f-479f-4f05-8b23-ebc61d2a3237 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:07.105974 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c52ab72f-479f-4f05-8b23-ebc61d2a3237 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:07.116868 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-abaf5e4e-f3a7-402c-aa9a-b3edcae36fc2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/os-volume_attachments/8aa7fb75-6804-4ba0-b287-1d645a8fe1b1" status: 200 len: 194 microversion: 2.20 time: 0.052042 Oct 27 17:37:07.126225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 375/717] 10.222.0.36 () {60 vars in 1454 bytes} [Thu Oct 27 17:37:07 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/os-volume_attachments/8aa7fb75-6804-4ba0-b287-1d645a8fe1b1 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:37:07.161455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c52ab72f-479f-4f05-8b23-ebc61d2a3237 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:07.162430 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c52ab72f-479f-4f05-8b23-ebc61d2a3237 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:07.162871 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c52ab72f-479f-4f05-8b23-ebc61d2a3237 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:07.163397 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-c52ab72f-479f-4f05-8b23-ebc61d2a3237 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lazy-loading 'fault' on Instance uuid 13686e3e-dfd4-4f2e-9781-92321ff85702 {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:37:07.212498 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-7f3e343c-75c3-4f98-9f20-aec688cb3883 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:07.213278 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-7f3e343c-75c3-4f98-9f20-aec688cb3883 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:07.219613 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f3e343c-75c3-4f98-9f20-aec688cb3883 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:07.220366 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f3e343c-75c3-4f98-9f20-aec688cb3883 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:07.223983 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-c52ab72f-479f-4f05-8b23-ebc61d2a3237 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:07.224700 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f3e343c-75c3-4f98-9f20-aec688cb3883 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:07.225955 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f3e343c-75c3-4f98-9f20-aec688cb3883 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:07.226509 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f3e343c-75c3-4f98-9f20-aec688cb3883 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:07.227416 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f3e343c-75c3-4f98-9f20-aec688cb3883 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:07.233913 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-c52ab72f-479f-4f05-8b23-ebc61d2a3237 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1331 microversion: 2.1 time: 0.148968 Oct 27 17:37:07.234492 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 343/718] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:07 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1331 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:07.323026 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.objects.instance [None req-7f3e343c-75c3-4f98-9f20-aec688cb3883 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lazy-loading 'services' on Instance uuid 2b27a822-4c22-45f0-872b-67e5f360f45e {{(pid=119047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:37:07.405718 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-7f3e343c-75c3-4f98-9f20-aec688cb3883 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/os-volume_attachments/8aa7fb75-6804-4ba0-b287-1d645a8fe1b1" status: 202 len: 0 microversion: 2.20 time: 0.195891 Oct 27 17:37:07.406581 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 376/719] 10.222.0.36 () {60 vars in 1457 bytes} [Thu Oct 27 17:37:07 2022] DELETE /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/os-volume_attachments/8aa7fb75-6804-4ba0-b287-1d645a8fe1b1 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:37:07.415416 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8af4cf10-b24d-49f8-b84b-ce94c5e4d259 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:07.417641 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8af4cf10-b24d-49f8-b84b-ce94c5e4d259 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:07.425313 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8af4cf10-b24d-49f8-b84b-ce94c5e4d259 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:07.425806 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8af4cf10-b24d-49f8-b84b-ce94c5e4d259 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:07.426434 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8af4cf10-b24d-49f8-b84b-ce94c5e4d259 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:07.427153 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8af4cf10-b24d-49f8-b84b-ce94c5e4d259 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:07.427612 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8af4cf10-b24d-49f8-b84b-ce94c5e4d259 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:07.428092 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8af4cf10-b24d-49f8-b84b-ce94c5e4d259 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:07.457722 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8af4cf10-b24d-49f8-b84b-ce94c5e4d259 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046844 Oct 27 17:37:07.458295 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 344/720] 10.222.0.36 () {60 vars in 1343 bytes} [Thu Oct 27 17:37:07 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:37:08.259303 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8fca68da-0b3c-478c-8ad7-adf61c896d77 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:08.260099 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8fca68da-0b3c-478c-8ad7-adf61c896d77 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:08.266791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8fca68da-0b3c-478c-8ad7-adf61c896d77 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:08.267267 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8fca68da-0b3c-478c-8ad7-adf61c896d77 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:08.267697 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8fca68da-0b3c-478c-8ad7-adf61c896d77 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:08.268434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8fca68da-0b3c-478c-8ad7-adf61c896d77 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:08.268879 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8fca68da-0b3c-478c-8ad7-adf61c896d77 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:08.269298 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8fca68da-0b3c-478c-8ad7-adf61c896d77 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:08.299920 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8fca68da-0b3c-478c-8ad7-adf61c896d77 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:08.300394 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8fca68da-0b3c-478c-8ad7-adf61c896d77 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:08.300823 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8fca68da-0b3c-478c-8ad7-adf61c896d77 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:08.301258 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.objects.instance [None req-8fca68da-0b3c-478c-8ad7-adf61c896d77 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lazy-loading 'fault' on Instance uuid 13686e3e-dfd4-4f2e-9781-92321ff85702 {{(pid=119047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:37:08.345221 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8fca68da-0b3c-478c-8ad7-adf61c896d77 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:08.353764 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8fca68da-0b3c-478c-8ad7-adf61c896d77 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 200 len: 1331 microversion: 2.1 time: 0.099059 Oct 27 17:37:08.354401 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 377/721] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:08 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:08.470782 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f4a01035-c4a5-42d3-82b0-1df436003068 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:08.473017 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-f4a01035-c4a5-42d3-82b0-1df436003068 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:08.479805 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4a01035-c4a5-42d3-82b0-1df436003068 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:08.480295 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4a01035-c4a5-42d3-82b0-1df436003068 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:08.480730 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4a01035-c4a5-42d3-82b0-1df436003068 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:08.481460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4a01035-c4a5-42d3-82b0-1df436003068 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:08.481874 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4a01035-c4a5-42d3-82b0-1df436003068 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:08.482296 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f4a01035-c4a5-42d3-82b0-1df436003068 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:08.513822 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f4a01035-c4a5-42d3-82b0-1df436003068 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047167 Oct 27 17:37:08.514442 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 345/722] 10.222.0.36 () {60 vars in 1343 bytes} [Thu Oct 27 17:37:08 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:37:09.377043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0db892e1-6a7f-4271-a57d-a74c8a683e5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:09.377650 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-0db892e1-6a7f-4271-a57d-a74c8a683e5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:09.384037 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0db892e1-6a7f-4271-a57d-a74c8a683e5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:09.384512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0db892e1-6a7f-4271-a57d-a74c8a683e5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:09.384939 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0db892e1-6a7f-4271-a57d-a74c8a683e5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:09.385618 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0db892e1-6a7f-4271-a57d-a74c8a683e5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:09.390548 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0db892e1-6a7f-4271-a57d-a74c8a683e5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:09.390984 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0db892e1-6a7f-4271-a57d-a74c8a683e5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:09.404519 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-0db892e1-6a7f-4271-a57d-a74c8a683e5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] HTTP exception thrown: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0db892e1-6a7f-4271-a57d-a74c8a683e5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Request method failure captured: Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 HTTP/1.1 Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA48P867QnVFetJM_7-4A7Zzy1y_BgK92PPcM5QN2sMM7rFRhLUgPfG-i71JivsPG4LadkJJ4XcZlaVkMTt9ACmFBCVr55uoiFNCoOee5ZYSDumbUSBNjRpORNBa4HVT1DYjC6OvQXdJDtZsCkYaDUqFgRE6zbJPygnGePlokMgMzQ Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:37:09.406780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:37:09.408434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}] Oct 27 17:37:09.408434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:37:09.408434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:37:09.408434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:37:09.408434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:37:09.408434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:37:09.408434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:37:09.408434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 3c36ea3a53cc48fa996891e3c6ddfda8 Oct 27 17:37:09.408434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:37:09.408434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:37:09.408434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. Oct 27 17:37:09.408434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': '13686e3e-dfd4-4f2e-9781-92321ff85702'} Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:37:09.409379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. Oct 27 17:37:09.410903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:09.412314 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0db892e1-6a7f-4271-a57d-a74c8a683e5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Returning 404 to user: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:37:09.412314 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0db892e1-6a7f-4271-a57d-a74c8a683e5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 404 len: 111 microversion: 2.1 time: 0.035054 Oct 27 17:37:09.412314 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 378/723] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:09 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:37:09.417301 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-881df061-94ee-48e5-b988-789eee70a39f tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '.version_select at 0x7f07887b55e0>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:09.435267 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-881df061-94ee-48e5-b988-789eee70a39f tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-243853759" status: 202 len: 0 microversion: 2.1 time: 0.021696 Oct 27 17:37:09.435832 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 346/724] 10.222.0.36 () {58 vars in 1218 bytes} [Thu Oct 27 17:37:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-243853759 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 17:37:09.526710 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8281139a-af7d-4991-9bd0-c0a8eeac5776 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:09.529122 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8281139a-af7d-4991-9bd0-c0a8eeac5776 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:09.535851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8281139a-af7d-4991-9bd0-c0a8eeac5776 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:09.536343 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8281139a-af7d-4991-9bd0-c0a8eeac5776 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:09.536781 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8281139a-af7d-4991-9bd0-c0a8eeac5776 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:09.537478 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8281139a-af7d-4991-9bd0-c0a8eeac5776 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:09.537938 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8281139a-af7d-4991-9bd0-c0a8eeac5776 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:09.538378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8281139a-af7d-4991-9bd0-c0a8eeac5776 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:09.574900 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8281139a-af7d-4991-9bd0-c0a8eeac5776 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052216 Oct 27 17:37:09.579637 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 379/725] 10.222.0.36 () {60 vars in 1343 bytes} [Thu Oct 27 17:37:09 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:09.649053 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-c888b7fb-5c14-46e4-b080-87fe9b78c7dd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:09.649603 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c888b7fb-5c14-46e4-b080-87fe9b78c7dd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:09.655326 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c888b7fb-5c14-46e4-b080-87fe9b78c7dd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:09.655826 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c888b7fb-5c14-46e4-b080-87fe9b78c7dd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:09.656263 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c888b7fb-5c14-46e4-b080-87fe9b78c7dd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:09.656953 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c888b7fb-5c14-46e4-b080-87fe9b78c7dd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:09.657395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c888b7fb-5c14-46e4-b080-87fe9b78c7dd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:09.657809 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c888b7fb-5c14-46e4-b080-87fe9b78c7dd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:09.686947 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c888b7fb-5c14-46e4-b080-87fe9b78c7dd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Going to try to terminate instance {{(pid=119046) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:37:09.768326 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-c888b7fb-5c14-46e4-b080-87fe9b78c7dd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 204 len: 0 microversion: 2.20 time: 0.123149 Oct 27 17:37:09.769330 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 347/726] 10.222.0.36 () {60 vars in 1280 bytes} [Thu Oct 27 17:37:09 2022] DELETE /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 17:37:09.777517 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-fcb303f5-b602-479d-991b-34e3000f179e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:09.778129 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-fcb303f5-b602-479d-991b-34e3000f179e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:09.784880 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcb303f5-b602-479d-991b-34e3000f179e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:09.785366 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcb303f5-b602-479d-991b-34e3000f179e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:09.785810 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcb303f5-b602-479d-991b-34e3000f179e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:09.786504 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcb303f5-b602-479d-991b-34e3000f179e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:09.786949 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcb303f5-b602-479d-991b-34e3000f179e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:09.787371 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcb303f5-b602-479d-991b-34e3000f179e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:10.004693 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fcb303f5-b602-479d-991b-34e3000f179e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:10.013463 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fcb303f5-b602-479d-991b-34e3000f179e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:10.015832 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fcb303f5-b602-479d-991b-34e3000f179e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:10.017414 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-fcb303f5-b602-479d-991b-34e3000f179e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.243622 Oct 27 17:37:10.017980 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 380/727] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:09 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:37:10.198279 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e7f82bad-33c0-47c7-8354-8d37cf669eb5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Action: 'create', calling method: .version_select at 0x7f078874d670>, body: {"keypair": {"name": "tempest-keypair-2097089373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtZlRv6Y5+5+96Xg8/Hu6N1XI8UCOy5SfgIqxyj4rbtXDYMWA27EBHVG/KFHUeBCHo4K58LWr85OmWEKdmxJJu1jktlkLLbu13SHsaBuU3LaFPdWzBssPrCzA8D6BV9xA=="}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:10.214516 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-e7f82bad-33c0-47c7-8354-8d37cf669eb5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Getting quotas for project a35c2b53ccb445d4b0dd2915376f69cf. Resources: {'key_pairs'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:37:10.219051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-e7f82bad-33c0-47c7-8354-8d37cf669eb5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Getting quotas for user 3c36ea3a53cc48fa996891e3c6ddfda8 and project a35c2b53ccb445d4b0dd2915376f69cf. Resources: {'key_pairs'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:37:10.240337 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e7f82bad-33c0-47c7-8354-8d37cf669eb5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046425 Oct 27 17:37:10.240949 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 348/728] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Oct 27 17:37:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:11.043266 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-124f0d58-c928-42a9-b73b-4e6113d4c3f6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:11.043908 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-124f0d58-c928-42a9-b73b-4e6113d4c3f6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:11.050830 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-124f0d58-c928-42a9-b73b-4e6113d4c3f6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:11.051311 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-124f0d58-c928-42a9-b73b-4e6113d4c3f6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:11.051768 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-124f0d58-c928-42a9-b73b-4e6113d4c3f6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:11.052486 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-124f0d58-c928-42a9-b73b-4e6113d4c3f6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:11.052937 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-124f0d58-c928-42a9-b73b-4e6113d4c3f6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:11.053355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-124f0d58-c928-42a9-b73b-4e6113d4c3f6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:11.260671 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-124f0d58-c928-42a9-b73b-4e6113d4c3f6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:11.269175 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-124f0d58-c928-42a9-b73b-4e6113d4c3f6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:11.270623 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-124f0d58-c928-42a9-b73b-4e6113d4c3f6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:11.271818 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-124f0d58-c928-42a9-b73b-4e6113d4c3f6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.232558 Oct 27 17:37:11.272368 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 381/729] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:11 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:37:11.320945 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9754ecaf-0a6c-4dc5-be98-2d900de70c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-61907169"}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:11.322132 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9754ecaf-0a6c-4dc5-be98-2d900de70c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:11.329398 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9754ecaf-0a6c-4dc5-be98-2d900de70c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:11.329892 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9754ecaf-0a6c-4dc5-be98-2d900de70c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:11.330329 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9754ecaf-0a6c-4dc5-be98-2d900de70c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:11.331030 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9754ecaf-0a6c-4dc5-be98-2d900de70c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:11.331495 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9754ecaf-0a6c-4dc5-be98-2d900de70c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:11.332047 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9754ecaf-0a6c-4dc5-be98-2d900de70c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:11.471634 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.network.security_group_api [None req-9754ecaf-0a6c-4dc5-be98-2d900de70c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Removing security group d243046f-b977-4927-92f4-611cc7de1cc9 from port e5243648-b4fa-47b1-96eb-9bf82da1c364 Oct 27 17:37:11.766423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2009277691", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "40b6c3a9-49a5-4aa8-abaa-a41beea7c111"}], "security_groups": [{"name": "tempest-securitygroup--652677099"}], "key_name": "tempest-keypair-2097089373", "user_data": "}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:11.785708 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9754ecaf-0a6c-4dc5-be98-2d900de70c18 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "POST /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/action" status: 202 len: 0 microversion: 2.1 time: 0.575780 Oct 27 17:37:11.786678 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 349/730] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Oct 27 17:37:11 2022] POST /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 17:37:11.798802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-a71c2ad1-a929-4117-b1cf-bf8426325115 req-d44e27d3-c8f1-4f55-9251-4c9839fd409c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95000566-a99d-4dc8-b509-bc86de3e8743", "tag": "e5243648-b4fa-47b1-96eb-9bf82da1c364"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:11.809184 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-a71c2ad1-a929-4117-b1cf-bf8426325115 req-d44e27d3-c8f1-4f55-9251-4c9839fd409c service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:11.810280 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-a71c2ad1-a929-4117-b1cf-bf8426325115 req-d44e27d3-c8f1-4f55-9251-4c9839fd409c service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:11.811005 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-a71c2ad1-a929-4117-b1cf-bf8426325115 req-d44e27d3-c8f1-4f55-9251-4c9839fd409c service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:11.828388 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-a71c2ad1-a929-4117-b1cf-bf8426325115 req-d44e27d3-c8f1-4f55-9251-4c9839fd409c service nova] Creating event network-changed:e5243648-b4fa-47b1-96eb-9bf82da1c364 for instance 95000566-a99d-4dc8-b509-bc86de3e8743 on hv-cinder-86283 Oct 27 17:37:11.833899 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-a71c2ad1-a929-4117-b1cf-bf8426325115 req-d44e27d3-c8f1-4f55-9251-4c9839fd409c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038950 Oct 27 17:37:11.835013 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 350/731] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:11.943532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.network.neutron [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] validate_networks() for [('40b6c3a9-49a5-4aa8-abaa-a41beea7c111', None, None, None, None, None)] {{(pid=119047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:37:12.298138 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-da4d9140-cf8f-4cc5-b18d-fb1d2926c368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:12.299605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-da4d9140-cf8f-4cc5-b18d-fb1d2926c368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:12.307616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-da4d9140-cf8f-4cc5-b18d-fb1d2926c368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:12.308066 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-da4d9140-cf8f-4cc5-b18d-fb1d2926c368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:12.308492 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-da4d9140-cf8f-4cc5-b18d-fb1d2926c368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:12.309184 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-da4d9140-cf8f-4cc5-b18d-fb1d2926c368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:12.309626 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-da4d9140-cf8f-4cc5-b18d-fb1d2926c368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:12.310740 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-da4d9140-cf8f-4cc5-b18d-fb1d2926c368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:12.604048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Flavor limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:37:12.605926 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Image limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:37:12.606836 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Flavor pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:37:12.606970 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Image pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:37:12.607450 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:37:12.620108 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:12.620896 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:12.621532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:12.622410 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:12.623043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:12.624176 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:12.630164 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-da4d9140-cf8f-4cc5-b18d-fb1d2926c368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:12.643121 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-da4d9140-cf8f-4cc5-b18d-fb1d2926c368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:12.651014 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-da4d9140-cf8f-4cc5-b18d-fb1d2926c368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:12.655748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-da4d9140-cf8f-4cc5-b18d-fb1d2926c368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1723 microversion: 2.20 time: 0.359940 Oct 27 17:37:12.660107 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 351/732] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:12 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:37:12.670969 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Getting quotas for project a35c2b53ccb445d4b0dd2915376f69cf. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:37:12.675521 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Getting quotas for user 3c36ea3a53cc48fa996891e3c6ddfda8 and project a35c2b53ccb445d4b0dd2915376f69cf. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:37:12.688435 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Going to run 1 instances... {{(pid=119047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:37:12.690771 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:37:12.745377 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-064e3f88-c16a-47a1-8920-eb5be785e734 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.983749 Oct 27 17:37:12.751870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 382/733] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:37:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 17:37:12.758143 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-be6b490b-7b67-42b8-a3a2-51620597a58e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:12.758756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-be6b490b-7b67-42b8-a3a2-51620597a58e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:12.859593 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-be6b490b-7b67-42b8-a3a2-51620597a58e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:12.867322 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-be6b490b-7b67-42b8-a3a2-51620597a58e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1242 microversion: 2.1 time: 0.113251 Oct 27 17:37:12.867921 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 352/734] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:12 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1242 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:13.226161 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-802957a0-88bf-4773-91f1-0bfe5c68652a req-d0d7b45e-18a0-469b-a293-5e817bc9a0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b27a822-4c22-45f0-872b-67e5f360f45e", "name": "network-vif-deleted", "tag": "8d525473-0013-4431-baf7-e343fbc1a2eb"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:13.239116 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:37:13.244097 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-802957a0-88bf-4773-91f1-0bfe5c68652a req-d0d7b45e-18a0-469b-a293-5e817bc9a0b8 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:13.244873 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-802957a0-88bf-4773-91f1-0bfe5c68652a req-d0d7b45e-18a0-469b-a293-5e817bc9a0b8 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:13.245511 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-802957a0-88bf-4773-91f1-0bfe5c68652a req-d0d7b45e-18a0-469b-a293-5e817bc9a0b8 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:13.259464 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-802957a0-88bf-4773-91f1-0bfe5c68652a req-d0d7b45e-18a0-469b-a293-5e817bc9a0b8 service nova] Creating event network-vif-deleted:8d525473-0013-4431-baf7-e343fbc1a2eb for instance 2b27a822-4c22-45f0-872b-67e5f360f45e on hv-cinder-86283 Oct 27 17:37:13.266542 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-802957a0-88bf-4773-91f1-0bfe5c68652a req-d0d7b45e-18a0-469b-a293-5e817bc9a0b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045121 Oct 27 17:37:13.267759 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 383/735] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:13.487675 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9afc2567-0bc1-4f27-ab81-b027aa7eff9d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:13.488209 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9afc2567-0bc1-4f27-ab81-b027aa7eff9d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:13.496914 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9afc2567-0bc1-4f27-ab81-b027aa7eff9d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:13.497756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9afc2567-0bc1-4f27-ab81-b027aa7eff9d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:13.498266 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9afc2567-0bc1-4f27-ab81-b027aa7eff9d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:13.499786 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9afc2567-0bc1-4f27-ab81-b027aa7eff9d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:13.500313 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9afc2567-0bc1-4f27-ab81-b027aa7eff9d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:13.500806 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9afc2567-0bc1-4f27-ab81-b027aa7eff9d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:13.600423 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-9afc2567-0bc1-4f27-ab81-b027aa7eff9d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lazy-loading 'services' on Instance uuid 95000566-a99d-4dc8-b509-bc86de3e8743 {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:37:13.689927 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-fcc239cd-3cb6-41b8-a047-aadaf5d28bf8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:13.691478 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-fcc239cd-3cb6-41b8-a047-aadaf5d28bf8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:13.696132 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9afc2567-0bc1-4f27-ab81-b027aa7eff9d tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "DELETE /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/os-volume_attachments/6cc0a793-c90b-4fc7-ab7e-b2a2203d8a2c" status: 202 len: 0 microversion: 2.1 time: 0.210223 Oct 27 17:37:13.700377 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcc239cd-3cb6-41b8-a047-aadaf5d28bf8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:13.700613 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 353/736] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Oct 27 17:37:13 2022] DELETE /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/os-volume_attachments/6cc0a793-c90b-4fc7-ab7e-b2a2203d8a2c => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:37:13.701288 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcc239cd-3cb6-41b8-a047-aadaf5d28bf8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:13.702573 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcc239cd-3cb6-41b8-a047-aadaf5d28bf8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:13.703458 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcc239cd-3cb6-41b8-a047-aadaf5d28bf8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:13.704094 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcc239cd-3cb6-41b8-a047-aadaf5d28bf8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:13.704668 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcc239cd-3cb6-41b8-a047-aadaf5d28bf8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:13.707485 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-5a48ae3a-2da1-4adb-98e9-b7143ee05f5e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:13.712060 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-5a48ae3a-2da1-4adb-98e9-b7143ee05f5e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:13.720454 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a48ae3a-2da1-4adb-98e9-b7143ee05f5e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:13.721257 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a48ae3a-2da1-4adb-98e9-b7143ee05f5e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:13.722355 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a48ae3a-2da1-4adb-98e9-b7143ee05f5e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:13.723352 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a48ae3a-2da1-4adb-98e9-b7143ee05f5e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:13.724178 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a48ae3a-2da1-4adb-98e9-b7143ee05f5e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:13.725186 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5a48ae3a-2da1-4adb-98e9-b7143ee05f5e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:13.751826 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcc239cd-3cb6-41b8-a047-aadaf5d28bf8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:13.752323 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcc239cd-3cb6-41b8-a047-aadaf5d28bf8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:13.752764 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fcc239cd-3cb6-41b8-a047-aadaf5d28bf8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:13.753418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.objects.instance [None req-fcc239cd-3cb6-41b8-a047-aadaf5d28bf8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lazy-loading 'fault' on Instance uuid 2b27a822-4c22-45f0-872b-67e5f360f45e {{(pid=119047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:37:13.762760 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-5a48ae3a-2da1-4adb-98e9-b7143ee05f5e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059809 Oct 27 17:37:13.769166 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 354/737] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:37:13 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:13.801500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fcc239cd-3cb6-41b8-a047-aadaf5d28bf8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:13.816529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fcc239cd-3cb6-41b8-a047-aadaf5d28bf8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:13.818900 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fcc239cd-3cb6-41b8-a047-aadaf5d28bf8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:13.820480 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-fcc239cd-3cb6-41b8-a047-aadaf5d28bf8 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 200 len: 1372 microversion: 2.20 time: 0.139333 Oct 27 17:37:13.821591 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 384/738] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:13 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 1372 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:37:13.851558 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-fb8b7615-9019-4327-848d-3d3e357104ec req-27148cb5-c20d-4123-a9a8-456969ede1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95000566-a99d-4dc8-b509-bc86de3e8743", "tag": "e5243648-b4fa-47b1-96eb-9bf82da1c364"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:13.861133 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-fb8b7615-9019-4327-848d-3d3e357104ec req-27148cb5-c20d-4123-a9a8-456969ede1c4 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:13.861912 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-fb8b7615-9019-4327-848d-3d3e357104ec req-27148cb5-c20d-4123-a9a8-456969ede1c4 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:13.862494 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-fb8b7615-9019-4327-848d-3d3e357104ec req-27148cb5-c20d-4123-a9a8-456969ede1c4 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:13.875630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-fb8b7615-9019-4327-848d-3d3e357104ec req-27148cb5-c20d-4123-a9a8-456969ede1c4 service nova] Creating event network-changed:e5243648-b4fa-47b1-96eb-9bf82da1c364 for instance 95000566-a99d-4dc8-b509-bc86de3e8743 on hv-cinder-86283 Oct 27 17:37:13.881134 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-fb8b7615-9019-4327-848d-3d3e357104ec req-27148cb5-c20d-4123-a9a8-456969ede1c4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033333 Oct 27 17:37:13.886303 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 355/739] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:13.890277 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b7a4c649-071b-46f5-b698-4949421c3843 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:13.890901 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b7a4c649-071b-46f5-b698-4949421c3843 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:13.962578 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-b7a4c649-071b-46f5-b698-4949421c3843 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:13.977996 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b7a4c649-071b-46f5-b698-4949421c3843 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1242 microversion: 2.1 time: 0.092088 Oct 27 17:37:13.979275 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 385/740] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:13 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:14.777489 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-36e1f891-2d9c-49d1-a788-4971d2712607 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:14.780515 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-36e1f891-2d9c-49d1-a788-4971d2712607 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:14.787897 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-36e1f891-2d9c-49d1-a788-4971d2712607 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:14.788382 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-36e1f891-2d9c-49d1-a788-4971d2712607 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:14.788957 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-36e1f891-2d9c-49d1-a788-4971d2712607 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:14.789664 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-36e1f891-2d9c-49d1-a788-4971d2712607 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:14.790111 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-36e1f891-2d9c-49d1-a788-4971d2712607 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:14.790553 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-36e1f891-2d9c-49d1-a788-4971d2712607 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:14.821919 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-36e1f891-2d9c-49d1-a788-4971d2712607 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048716 Oct 27 17:37:14.822498 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 356/741] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:37:14 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:14.846497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-82c040ce-329c-4d27-8477-d621dc285a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:14.847097 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-82c040ce-329c-4d27-8477-d621dc285a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:14.854411 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-82c040ce-329c-4d27-8477-d621dc285a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:14.854885 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-82c040ce-329c-4d27-8477-d621dc285a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:14.855337 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-82c040ce-329c-4d27-8477-d621dc285a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:14.856042 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-82c040ce-329c-4d27-8477-d621dc285a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:14.856484 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-82c040ce-329c-4d27-8477-d621dc285a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:14.856898 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-82c040ce-329c-4d27-8477-d621dc285a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:14.871186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-82c040ce-329c-4d27-8477-d621dc285a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] HTTP exception thrown: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-82c040ce-329c-4d27-8477-d621dc285a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Request method failure captured: Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e HTTP/1.1 Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA07JRNIIigKkKj39DZsCXRhadJ6r1jJOY3yUFcvJ0JX0pRLqqjDmQopGzDS3rPQwEvgFBAXlx6x-LnkGlMVsUW7p8s6Lcg-FdtiF9eb2sLSoxpVrmxQPG7i8Kf8un2OnIw0_FdiPJZHvpsLm8bmkoGSYqci7c7CqkXXp-Clpu-258 Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: 48c1b56e78014b57918f3c4b7ed32114 Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:37:14.872924 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:37:14.875050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48c1b56e78014b57918f3c4b7ed32114"}]}] Oct 27 17:37:14.875050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:37:14.875050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: 48c1b56e78014b57918f3c4b7ed32114 Oct 27 17:37:14.875050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:37:14.875050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-AttachVolumeShelveTestJSON-269718429-project Oct 27 17:37:14.875050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:37:14.875050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:37:14.875050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 1d8ef8bb0fa645048c6389bd1402c471 Oct 27 17:37:14.875050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269718429-project Oct 27 17:37:14.875050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:37:14.875050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. Oct 27 17:37:14.875050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': '2b27a822-4c22-45f0-872b-67e5f360f45e'} Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:37:14.876033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. Oct 27 17:37:14.877297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:14.878369 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-82c040ce-329c-4d27-8477-d621dc285a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Returning 404 to user: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:37:14.878369 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-82c040ce-329c-4d27-8477-d621dc285a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 404 len: 111 microversion: 2.20 time: 0.032324 Oct 27 17:37:14.878369 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 386/742] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:14 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 17:37:14.883950 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ce43e269-d870-46ec-a835-49aa7d53a58f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '.version_select at 0x7f0788670280>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:14.902888 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ce43e269-d870-46ec-a835-49aa7d53a58f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1950584043" status: 204 len: 0 microversion: 2.20 time: 0.022755 Oct 27 17:37:14.903458 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 357/743] 10.222.0.36 () {60 vars in 1262 bytes} [Thu Oct 27 17:37:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1950584043 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 17:37:15.004361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4f9a39d9-81ef-4c76-9688-b615b7ab1f95 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:15.005083 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4f9a39d9-81ef-4c76-9688-b615b7ab1f95 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:15.090730 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4f9a39d9-81ef-4c76-9688-b615b7ab1f95 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:15.098005 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4f9a39d9-81ef-4c76-9688-b615b7ab1f95 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1242 microversion: 2.1 time: 0.099382 Oct 27 17:37:15.098982 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 387/744] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:14 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:15.598786 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-489b25d3-c80f-41ae-bb2d-236a581ff1fb tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Action: 'create', calling method: .version_select at 0x7f078858ddc0>, body: {"keypair": {"name": "tempest-keypair-1788232169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2ihBCX8q/eDxiD1Ay0EmiW1ic9larYU6gXJSTtS02k7ekgnPYgv5bl3N5KraFPSuS+azFbLU5ZfWb+hypp3dqNunssIylu1VyVyWIGOJ52171zGJ7Oq/IeovtAhMqx+Q=="}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:15.615279 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-489b25d3-c80f-41ae-bb2d-236a581ff1fb tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Getting quotas for project 48c1b56e78014b57918f3c4b7ed32114. Resources: {'key_pairs'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:37:15.619055 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-489b25d3-c80f-41ae-bb2d-236a581ff1fb tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Getting quotas for user 1d8ef8bb0fa645048c6389bd1402c471 and project 48c1b56e78014b57918f3c4b7ed32114. Resources: {'key_pairs'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:37:15.640253 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-489b25d3-c80f-41ae-bb2d-236a581ff1fb tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045321 Oct 27 17:37:15.640841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 358/745] 10.222.0.36 () {62 vars in 1200 bytes} [Thu Oct 27 17:37:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 17:37:15.834216 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8087d509-15bc-4521-a99f-c913b965a9e7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:15.836528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8087d509-15bc-4521-a99f-c913b965a9e7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:15.843773 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8087d509-15bc-4521-a99f-c913b965a9e7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:15.844269 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8087d509-15bc-4521-a99f-c913b965a9e7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:15.844707 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8087d509-15bc-4521-a99f-c913b965a9e7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:15.845406 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8087d509-15bc-4521-a99f-c913b965a9e7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:15.845863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8087d509-15bc-4521-a99f-c913b965a9e7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:15.846294 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8087d509-15bc-4521-a99f-c913b965a9e7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:15.879514 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8087d509-15bc-4521-a99f-c913b965a9e7 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049251 Oct 27 17:37:15.880739 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 388/746] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:37:15 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 17:37:15.891919 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a612a212-6403-4ca8-9998-20a235d692b5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:15.892437 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a612a212-6403-4ca8-9998-20a235d692b5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:15.898889 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a612a212-6403-4ca8-9998-20a235d692b5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:15.899343 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a612a212-6403-4ca8-9998-20a235d692b5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:15.899805 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a612a212-6403-4ca8-9998-20a235d692b5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:15.900501 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a612a212-6403-4ca8-9998-20a235d692b5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:15.900980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a612a212-6403-4ca8-9998-20a235d692b5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:15.901457 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a612a212-6403-4ca8-9998-20a235d692b5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:15.980053 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-a612a212-6403-4ca8-9998-20a235d692b5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] HTTP exception thrown: Instance 95000566-a99d-4dc8-b509-bc86de3e8743 is not attached to volume 6cc0a793-c90b-4fc7-ab7e-b2a2203d8a2c Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a612a212-6403-4ca8-9998-20a235d692b5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Request method failure captured: Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: DELETE /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/os-volume_attachments/6cc0a793-c90b-4fc7-ab7e-b2a2203d8a2c HTTP/1.1 Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsCIU1-niUpRYQssgjjq2t1HK9hwuEv-p2kKctNDD8B3dcWHbB9BYDv9DY5Ny7ERzr5y3-jUW6mjjvu5XOEvakcLVpem_QHyPrNfBd7WWJtFH7G9iO8zD_4CxRqVAFX0B3SsYJDnyv_fW-3Ogl5128EP9VAQGBbOjuaN-8xohImPYxI Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: 9dcd831cfdd74db99f8e0b07b84f41d7 Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-TestMinimumBasicScenario-991999675 Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:37:15.982486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:37:15.984433 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9dcd831cfdd74db99f8e0b07b84f41d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9dcd831cfdd74db99f8e0b07b84f41d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9dcd831cfdd74db99f8e0b07b84f41d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9dcd831cfdd74db99f8e0b07b84f41d7"}]}] Oct 27 17:37:15.984433 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-TestMinimumBasicScenario-991999675 Oct 27 17:37:15.984433 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: 9dcd831cfdd74db99f8e0b07b84f41d7 Oct 27 17:37:15.984433 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-TestMinimumBasicScenario-991999675 Oct 27 17:37:15.984433 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-TestMinimumBasicScenario-991999675-project Oct 27 17:37:15.984433 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:37:15.984433 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:37:15.984433 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 930279b9b9b94549b78c62d9f681d198 Oct 27 17:37:15.984433 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-TestMinimumBasicScenario-991999675-project Oct 27 17:37:15.984433 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:37:15.984433 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance 95000566-a99d-4dc8-b509-bc86de3e8743 is not attached to volume 6cc0a793-c90b-4fc7-ab7e-b2a2203d8a2c Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'server_id': '95000566-a99d-4dc8-b509-bc86de3e8743', 'id': '6cc0a793-c90b-4fc7-ab7e-b2a2203d8a2c'} Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6cc0a793-c90b-4fc7-ab7e-b2a2203d8a2c. Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:37:15.985254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:37:15.986667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:37:15.986667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 17:37:15.986667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 17:37:15.986667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95000566-a99d-4dc8-b509-bc86de3e8743 is not attached to volume 6cc0a793-c90b-4fc7-ab7e-b2a2203d8a2c Oct 27 17:37:15.986667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:37:15.986667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:37:15.986667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:37:15.986667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:15.986667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:37:15.986667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:37:15.986667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:37:15.986667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:37:15.986667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95000566-a99d-4dc8-b509-bc86de3e8743 is not attached to volume 6cc0a793-c90b-4fc7-ab7e-b2a2203d8a2c Oct 27 17:37:15.986667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:37:15.986667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a612a212-6403-4ca8-9998-20a235d692b5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Returning 404 to user: Instance 95000566-a99d-4dc8-b509-bc86de3e8743 is not attached to volume 6cc0a793-c90b-4fc7-ab7e-b2a2203d8a2c {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:37:15.987648 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a612a212-6403-4ca8-9998-20a235d692b5 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "DELETE /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/os-volume_attachments/6cc0a793-c90b-4fc7-ab7e-b2a2203d8a2c" status: 404 len: 154 microversion: 2.1 time: 0.096599 Oct 27 17:37:15.987648 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 359/747] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Oct 27 17:37:15 2022] DELETE /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743/os-volume_attachments/6cc0a793-c90b-4fc7-ab7e-b2a2203d8a2c => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:37:16.122611 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c55179cb-e733-4bd1-b0ff-3f738faf34ae tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:16.123351 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c55179cb-e733-4bd1-b0ff-3f738faf34ae tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:16.176259 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c55179cb-e733-4bd1-b0ff-3f738faf34ae tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:16.183317 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c55179cb-e733-4bd1-b0ff-3f738faf34ae tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1242 microversion: 2.1 time: 0.064663 Oct 27 17:37:16.183902 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 389/748] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:16 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:17.089440 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1094129758", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "421d9227-c86b-4ebb-ad1d-0e58ea3c13fb"}], "security_groups": [{"name": "tempest-securitygroup--1474850374"}], "key_name": "tempest-keypair-1788232169", "user_data": "}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:17.137317 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-eabea836-14d6-405c-b7ab-32a1ded3aab2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:17.137811 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-eabea836-14d6-405c-b7ab-32a1ded3aab2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:17.145137 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eabea836-14d6-405c-b7ab-32a1ded3aab2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:17.145616 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eabea836-14d6-405c-b7ab-32a1ded3aab2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:17.146047 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eabea836-14d6-405c-b7ab-32a1ded3aab2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:17.146730 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eabea836-14d6-405c-b7ab-32a1ded3aab2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:17.147172 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eabea836-14d6-405c-b7ab-32a1ded3aab2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:17.147618 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eabea836-14d6-405c-b7ab-32a1ded3aab2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:17.172878 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-eabea836-14d6-405c-b7ab-32a1ded3aab2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Going to try to terminate instance {{(pid=119047) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:37:17.195500 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.network.neutron [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] validate_networks() for [('421d9227-c86b-4ebb-ad1d-0e58ea3c13fb', None, None, None, None, None)] {{(pid=119046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:37:17.216902 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:37:17.251628 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-eabea836-14d6-405c-b7ab-32a1ded3aab2 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "DELETE /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 204 len: 0 microversion: 2.1 time: 0.117894 Oct 27 17:37:17.253412 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 390/749] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:37:17 2022] DELETE /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 17:37:17.260927 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6f8fd46b-3db0-4b63-8c1c-c35b7d61457c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:17.261622 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-6f8fd46b-3db0-4b63-8c1c-c35b7d61457c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:17.267666 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6f8fd46b-3db0-4b63-8c1c-c35b7d61457c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:17.268230 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6f8fd46b-3db0-4b63-8c1c-c35b7d61457c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:17.268659 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6f8fd46b-3db0-4b63-8c1c-c35b7d61457c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:17.269342 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6f8fd46b-3db0-4b63-8c1c-c35b7d61457c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:17.269789 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6f8fd46b-3db0-4b63-8c1c-c35b7d61457c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:17.270214 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6f8fd46b-3db0-4b63-8c1c-c35b7d61457c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:17.333345 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-6f8fd46b-3db0-4b63-8c1c-c35b7d61457c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:17.342881 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6f8fd46b-3db0-4b63-8c1c-c35b7d61457c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1246 microversion: 2.1 time: 0.085471 Oct 27 17:37:17.343744 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 391/750] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:17 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:17.348081 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d1fb5d4d-bca3-4908-bf0f-bd6894c9e8f6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:17.348689 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d1fb5d4d-bca3-4908-bf0f-bd6894c9e8f6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:17.354973 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1fb5d4d-bca3-4908-bf0f-bd6894c9e8f6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:17.355668 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1fb5d4d-bca3-4908-bf0f-bd6894c9e8f6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:17.356182 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1fb5d4d-bca3-4908-bf0f-bd6894c9e8f6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:17.356873 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1fb5d4d-bca3-4908-bf0f-bd6894c9e8f6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:17.357323 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1fb5d4d-bca3-4908-bf0f-bd6894c9e8f6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:17.358378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1fb5d4d-bca3-4908-bf0f-bd6894c9e8f6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:17.395490 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:37:17.490358 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d1fb5d4d-bca3-4908-bf0f-bd6894c9e8f6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:17.498116 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d1fb5d4d-bca3-4908-bf0f-bd6894c9e8f6 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1554 microversion: 2.1 time: 0.153647 Oct 27 17:37:17.507740 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 392/751] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:17 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:17.633326 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Flavor limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:37:17.633748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Image limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:37:17.634214 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Flavor pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:37:17.634615 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Image pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:37:17.635076 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:37:17.643797 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:17.644233 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:17.644662 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:17.645377 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:17.645850 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:17.646290 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:17.662607 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Getting quotas for project 48c1b56e78014b57918f3c4b7ed32114. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:37:17.666581 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Getting quotas for user 1d8ef8bb0fa645048c6389bd1402c471 and project 48c1b56e78014b57918f3c4b7ed32114. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:37:17.678017 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Going to run 1 instances... {{(pid=119046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:37:17.680281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:37:17.726487 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-134cad57-5c95-4a26-8ea6-f8d066f78918 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.641278 Oct 27 17:37:17.727116 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 360/752] 10.222.0.36 () {62 vars in 1188 bytes} [Thu Oct 27 17:37:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 17:37:17.738778 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-29082455-1ed0-4a6c-89ef-f27524bc8386 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:17.739386 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-29082455-1ed0-4a6c-89ef-f27524bc8386 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:17.794520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-29082455-1ed0-4a6c-89ef-f27524bc8386 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:17.802394 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-29082455-1ed0-4a6c-89ef-f27524bc8386 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:17.803862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-29082455-1ed0-4a6c-89ef-f27524bc8386 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:17.804959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-29082455-1ed0-4a6c-89ef-f27524bc8386 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1282 microversion: 2.20 time: 0.070053 Oct 27 17:37:17.805509 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 393/753] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:17 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:37:18.366424 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-dede77bf-c887-46ea-b2c2-9cf4ab6acefb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:18.367029 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-dede77bf-c887-46ea-b2c2-9cf4ab6acefb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:18.376298 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dede77bf-c887-46ea-b2c2-9cf4ab6acefb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:18.376780 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dede77bf-c887-46ea-b2c2-9cf4ab6acefb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:18.377206 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dede77bf-c887-46ea-b2c2-9cf4ab6acefb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:18.377885 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dede77bf-c887-46ea-b2c2-9cf4ab6acefb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:18.378329 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dede77bf-c887-46ea-b2c2-9cf4ab6acefb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:18.378745 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dede77bf-c887-46ea-b2c2-9cf4ab6acefb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:18.438547 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-dede77bf-c887-46ea-b2c2-9cf4ab6acefb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:18.446041 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-dede77bf-c887-46ea-b2c2-9cf4ab6acefb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1246 microversion: 2.1 time: 0.084201 Oct 27 17:37:18.446586 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 361/754] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:18 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:18.521949 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-84c6996d-63ea-4d37-8ce9-76dfbd6ec5f3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:18.522559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-84c6996d-63ea-4d37-8ce9-76dfbd6ec5f3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:18.530361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84c6996d-63ea-4d37-8ce9-76dfbd6ec5f3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:18.530835 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84c6996d-63ea-4d37-8ce9-76dfbd6ec5f3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:18.531265 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84c6996d-63ea-4d37-8ce9-76dfbd6ec5f3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:18.531983 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84c6996d-63ea-4d37-8ce9-76dfbd6ec5f3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:18.532437 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84c6996d-63ea-4d37-8ce9-76dfbd6ec5f3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:18.532857 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84c6996d-63ea-4d37-8ce9-76dfbd6ec5f3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:18.660564 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-84c6996d-63ea-4d37-8ce9-76dfbd6ec5f3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:18.668347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-84c6996d-63ea-4d37-8ce9-76dfbd6ec5f3 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1554 microversion: 2.1 time: 0.150307 Oct 27 17:37:18.668906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 394/755] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:18 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:18.830789 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-aee9c9f7-b517-471d-8519-550ce9f44a92 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:18.831384 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-aee9c9f7-b517-471d-8519-550ce9f44a92 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:18.837322 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aee9c9f7-b517-471d-8519-550ce9f44a92 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:18.837798 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aee9c9f7-b517-471d-8519-550ce9f44a92 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:18.838227 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aee9c9f7-b517-471d-8519-550ce9f44a92 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:18.838932 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aee9c9f7-b517-471d-8519-550ce9f44a92 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:18.839376 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aee9c9f7-b517-471d-8519-550ce9f44a92 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:18.839835 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aee9c9f7-b517-471d-8519-550ce9f44a92 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:18.844245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:37:18.911431 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-aee9c9f7-b517-471d-8519-550ce9f44a92 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:18.919651 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-aee9c9f7-b517-471d-8519-550ce9f44a92 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:18.921859 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-aee9c9f7-b517-471d-8519-550ce9f44a92 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:18.923046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-aee9c9f7-b517-471d-8519-550ce9f44a92 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1286 microversion: 2.20 time: 0.096601 Oct 27 17:37:18.923997 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 362/756] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:18 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:37:19.468820 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2eac5bba-5fcd-4b69-a023-f78933f6185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:19.469355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2eac5bba-5fcd-4b69-a023-f78933f6185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:19.475968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2eac5bba-5fcd-4b69-a023-f78933f6185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:19.476447 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2eac5bba-5fcd-4b69-a023-f78933f6185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:19.476881 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2eac5bba-5fcd-4b69-a023-f78933f6185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:19.477566 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2eac5bba-5fcd-4b69-a023-f78933f6185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:19.478018 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2eac5bba-5fcd-4b69-a023-f78933f6185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:19.478438 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2eac5bba-5fcd-4b69-a023-f78933f6185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:19.538025 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2eac5bba-5fcd-4b69-a023-f78933f6185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:19.545643 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2eac5bba-5fcd-4b69-a023-f78933f6185b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1294 microversion: 2.1 time: 0.080842 Oct 27 17:37:19.546209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 395/757] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:19 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1294 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:19.691585 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-cd1431b2-2ec2-4042-93b6-d4e76c25bb6a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:19.692377 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-cd1431b2-2ec2-4042-93b6-d4e76c25bb6a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:19.699137 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cd1431b2-2ec2-4042-93b6-d4e76c25bb6a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:19.699693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cd1431b2-2ec2-4042-93b6-d4e76c25bb6a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:19.700258 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cd1431b2-2ec2-4042-93b6-d4e76c25bb6a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:19.701011 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cd1431b2-2ec2-4042-93b6-d4e76c25bb6a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:19.701528 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cd1431b2-2ec2-4042-93b6-d4e76c25bb6a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:19.702015 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cd1431b2-2ec2-4042-93b6-d4e76c25bb6a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:19.829178 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-cd1431b2-2ec2-4042-93b6-d4e76c25bb6a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:19.836830 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-cd1431b2-2ec2-4042-93b6-d4e76c25bb6a tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1554 microversion: 2.1 time: 0.149085 Oct 27 17:37:19.837398 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 363/758] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:19 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:19.948232 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-9c4fbbc1-fb4f-49b0-a0bc-9df27cdd4c25 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:19.949059 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-9c4fbbc1-fb4f-49b0-a0bc-9df27cdd4c25 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:19.955179 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9c4fbbc1-fb4f-49b0-a0bc-9df27cdd4c25 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:19.955667 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9c4fbbc1-fb4f-49b0-a0bc-9df27cdd4c25 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:19.956140 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9c4fbbc1-fb4f-49b0-a0bc-9df27cdd4c25 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:19.956846 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9c4fbbc1-fb4f-49b0-a0bc-9df27cdd4c25 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:19.957301 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9c4fbbc1-fb4f-49b0-a0bc-9df27cdd4c25 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:19.957720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9c4fbbc1-fb4f-49b0-a0bc-9df27cdd4c25 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:20.052002 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9c4fbbc1-fb4f-49b0-a0bc-9df27cdd4c25 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:20.064223 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9c4fbbc1-fb4f-49b0-a0bc-9df27cdd4c25 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:20.064525 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9c4fbbc1-fb4f-49b0-a0bc-9df27cdd4c25 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:20.065631 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-9c4fbbc1-fb4f-49b0-a0bc-9df27cdd4c25 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1278 microversion: 2.20 time: 0.121464 Oct 27 17:37:20.066709 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 396/759] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:19 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1278 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:37:20.100639 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-b3d8dfbd-0bf8-41a6-ac5f-fe8b6ced545c req-56418b8f-99be-49ea-8d5f-d4cf82d4f570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95000566-a99d-4dc8-b509-bc86de3e8743", "name": "network-vif-deleted", "tag": "e5243648-b4fa-47b1-96eb-9bf82da1c364"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:20.111562 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-b3d8dfbd-0bf8-41a6-ac5f-fe8b6ced545c req-56418b8f-99be-49ea-8d5f-d4cf82d4f570 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:20.112062 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-b3d8dfbd-0bf8-41a6-ac5f-fe8b6ced545c req-56418b8f-99be-49ea-8d5f-d4cf82d4f570 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:20.112508 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-b3d8dfbd-0bf8-41a6-ac5f-fe8b6ced545c req-56418b8f-99be-49ea-8d5f-d4cf82d4f570 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:20.123963 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-b3d8dfbd-0bf8-41a6-ac5f-fe8b6ced545c req-56418b8f-99be-49ea-8d5f-d4cf82d4f570 service nova] Creating event network-vif-deleted:e5243648-b4fa-47b1-96eb-9bf82da1c364 for instance 95000566-a99d-4dc8-b509-bc86de3e8743 on hv-cinder-86283 Oct 27 17:37:20.128963 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-b3d8dfbd-0bf8-41a6-ac5f-fe8b6ced545c req-56418b8f-99be-49ea-8d5f-d4cf82d4f570 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032457 Oct 27 17:37:20.129489 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 364/760] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:37:20.569069 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0973bb54-887c-4f24-a993-83822be5943a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:20.569677 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-0973bb54-887c-4f24-a993-83822be5943a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:20.576794 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0973bb54-887c-4f24-a993-83822be5943a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:20.577482 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0973bb54-887c-4f24-a993-83822be5943a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:20.578100 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0973bb54-887c-4f24-a993-83822be5943a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:20.578958 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0973bb54-887c-4f24-a993-83822be5943a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:20.580174 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0973bb54-887c-4f24-a993-83822be5943a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:20.580603 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0973bb54-887c-4f24-a993-83822be5943a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:20.645029 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-0973bb54-887c-4f24-a993-83822be5943a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:20.653088 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0973bb54-887c-4f24-a993-83822be5943a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1300 microversion: 2.1 time: 0.087824 Oct 27 17:37:20.653648 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 397/761] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:20 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:20.862546 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-824336dd-7323-4a7a-85ae-156e8167e570 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:20.863998 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-824336dd-7323-4a7a-85ae-156e8167e570 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:20.875524 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-824336dd-7323-4a7a-85ae-156e8167e570 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:20.876021 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-824336dd-7323-4a7a-85ae-156e8167e570 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:20.881250 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-824336dd-7323-4a7a-85ae-156e8167e570 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:20.882521 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-824336dd-7323-4a7a-85ae-156e8167e570 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:20.882521 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-824336dd-7323-4a7a-85ae-156e8167e570 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:20.885994 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-824336dd-7323-4a7a-85ae-156e8167e570 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:20.933538 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-824336dd-7323-4a7a-85ae-156e8167e570 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:20.934008 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-824336dd-7323-4a7a-85ae-156e8167e570 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:20.934614 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-824336dd-7323-4a7a-85ae-156e8167e570 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:20.935211 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-824336dd-7323-4a7a-85ae-156e8167e570 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lazy-loading 'fault' on Instance uuid 95000566-a99d-4dc8-b509-bc86de3e8743 {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:37:20.991057 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-824336dd-7323-4a7a-85ae-156e8167e570 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930279b9b9b94549b78c62d9f681d198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dcd831cfdd74db99f8e0b07b84f41d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:21.003667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-824336dd-7323-4a7a-85ae-156e8167e570 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 200 len: 1348 microversion: 2.1 time: 0.147421 Oct 27 17:37:21.004958 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 365/762] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:20 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 1348 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:21.090365 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-e6f577fb-013f-46eb-b19f-11123d117f44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:21.091184 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e6f577fb-013f-46eb-b19f-11123d117f44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:21.102039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e6f577fb-013f-46eb-b19f-11123d117f44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:21.102783 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e6f577fb-013f-46eb-b19f-11123d117f44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:21.103376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e6f577fb-013f-46eb-b19f-11123d117f44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:21.104472 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e6f577fb-013f-46eb-b19f-11123d117f44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:21.106534 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e6f577fb-013f-46eb-b19f-11123d117f44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:21.107187 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e6f577fb-013f-46eb-b19f-11123d117f44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:21.230155 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e6f577fb-013f-46eb-b19f-11123d117f44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:21.239967 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e6f577fb-013f-46eb-b19f-11123d117f44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:21.241707 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e6f577fb-013f-46eb-b19f-11123d117f44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:21.242832 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-e6f577fb-013f-46eb-b19f-11123d117f44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1342 microversion: 2.20 time: 0.156389 Oct 27 17:37:21.243562 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 398/763] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:21 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1342 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:37:21.666003 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-72c3a6e6-b5e9-445b-b583-a48062706383 req-ad752797-10dc-4897-897a-3310ef539fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be393ea8-0e26-4c60-8b50-bab24362d246", "tag": "cf522c5e-a944-4450-8095-8875d39f901e"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:21.675835 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-83106fa0-aba8-430c-8ce7-f8939b52ad97 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:21.676509 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-83106fa0-aba8-430c-8ce7-f8939b52ad97 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:21.688352 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83106fa0-aba8-430c-8ce7-f8939b52ad97 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:21.688937 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83106fa0-aba8-430c-8ce7-f8939b52ad97 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:21.691453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-72c3a6e6-b5e9-445b-b583-a48062706383 req-ad752797-10dc-4897-897a-3310ef539fbf service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:21.691900 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83106fa0-aba8-430c-8ce7-f8939b52ad97 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:21.692692 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83106fa0-aba8-430c-8ce7-f8939b52ad97 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:21.693211 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83106fa0-aba8-430c-8ce7-f8939b52ad97 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:21.693706 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-83106fa0-aba8-430c-8ce7-f8939b52ad97 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:21.698240 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-72c3a6e6-b5e9-445b-b583-a48062706383 req-ad752797-10dc-4897-897a-3310ef539fbf service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:21.698749 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-72c3a6e6-b5e9-445b-b583-a48062706383 req-ad752797-10dc-4897-897a-3310ef539fbf service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:21.717818 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-72c3a6e6-b5e9-445b-b583-a48062706383 req-ad752797-10dc-4897-897a-3310ef539fbf service nova] Creating event network-changed:cf522c5e-a944-4450-8095-8875d39f901e for instance be393ea8-0e26-4c60-8b50-bab24362d246 on hv-cinder-86283 Oct 27 17:37:21.723482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-72c3a6e6-b5e9-445b-b583-a48062706383 req-ad752797-10dc-4897-897a-3310ef539fbf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062403 Oct 27 17:37:21.724169 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 366/764] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:21.911394 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-83106fa0-aba8-430c-8ce7-f8939b52ad97 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:21.921645 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-83106fa0-aba8-430c-8ce7-f8939b52ad97 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1367 microversion: 2.1 time: 0.249417 Oct 27 17:37:21.938298 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 399/765] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:21 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:37:22.030262 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-168a859f-8bd8-449a-ab94-6f10db0d529e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:22.031196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-168a859f-8bd8-449a-ab94-6f10db0d529e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] [instance: 95000566-a99d-4dc8-b509-bc86de3e8743] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:22.040477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-168a859f-8bd8-449a-ab94-6f10db0d529e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:22.041290 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-168a859f-8bd8-449a-ab94-6f10db0d529e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:22.041604 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-168a859f-8bd8-449a-ab94-6f10db0d529e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:22.042306 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-168a859f-8bd8-449a-ab94-6f10db0d529e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:22.043464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-168a859f-8bd8-449a-ab94-6f10db0d529e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:22.043864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-168a859f-8bd8-449a-ab94-6f10db0d529e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:22.058737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-168a859f-8bd8-449a-ab94-6f10db0d529e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] HTTP exception thrown: Instance 95000566-a99d-4dc8-b509-bc86de3e8743 could not be found. Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-168a859f-8bd8-449a-ab94-6f10db0d529e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Request method failure captured: Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 HTTP/1.1 Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsCIU1-niUpRYQssgjjq2t1HK9hwuEv-p2kKctNDD8B3dcWHbB9BYDv9DY5Ny7ERzr5y3-jUW6mjjvu5XOEvakcLVpem_QHyPrNfBd7WWJtFH7G9iO8zD_4CxRqVAFX0B3SsYJDnyv_fW-3Ogl5128EP9VAQGBbOjuaN-8xohImPYxI Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: 9dcd831cfdd74db99f8e0b07b84f41d7 Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-TestMinimumBasicScenario-991999675 Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:37:22.060418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:37:22.061977 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9dcd831cfdd74db99f8e0b07b84f41d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9dcd831cfdd74db99f8e0b07b84f41d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9dcd831cfdd74db99f8e0b07b84f41d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9dcd831cfdd74db99f8e0b07b84f41d7"}]}] Oct 27 17:37:22.061977 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-TestMinimumBasicScenario-991999675 Oct 27 17:37:22.061977 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: 9dcd831cfdd74db99f8e0b07b84f41d7 Oct 27 17:37:22.061977 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-TestMinimumBasicScenario-991999675 Oct 27 17:37:22.061977 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-TestMinimumBasicScenario-991999675-project Oct 27 17:37:22.061977 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:37:22.061977 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:37:22.061977 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 930279b9b9b94549b78c62d9f681d198 Oct 27 17:37:22.061977 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-TestMinimumBasicScenario-991999675-project Oct 27 17:37:22.061977 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:37:22.061977 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance 95000566-a99d-4dc8-b509-bc86de3e8743 could not be found. Oct 27 17:37:22.061977 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '95000566-a99d-4dc8-b509-bc86de3e8743'} Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95000566-a99d-4dc8-b509-bc86de3e8743 could not be found. Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:37:22.066103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95000566-a99d-4dc8-b509-bc86de3e8743 could not be found. Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95000566-a99d-4dc8-b509-bc86de3e8743 could not be found. Oct 27 17:37:22.067321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:37:22.068475 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-168a859f-8bd8-449a-ab94-6f10db0d529e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Returning 404 to user: Instance 95000566-a99d-4dc8-b509-bc86de3e8743 could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:37:22.068475 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-168a859f-8bd8-449a-ab94-6f10db0d529e tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743" status: 404 len: 111 microversion: 2.1 time: 0.036629 Oct 27 17:37:22.068475 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 367/766] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:22 2022] GET /compute/v2.1/servers/95000566-a99d-4dc8-b509-bc86de3e8743 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:37:22.072052 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6ee8ce18-e51e-46f0-9e1d-5a118c613444 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] Calling method '.version_select at 0x7f078bf6e280>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:22.110661 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6ee8ce18-e51e-46f0-9e1d-5a118c613444 tempest-TestMinimumBasicScenario-991999675 tempest-TestMinimumBasicScenario-991999675-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1372919521" status: 202 len: 0 microversion: 2.1 time: 0.043030 Oct 27 17:37:22.113760 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 400/767] 10.222.0.36 () {58 vars in 1272 bytes} [Thu Oct 27 17:37:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1372919521 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:37:22.268696 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-95f649a4-f7e1-4568-8f1c-fa2498dff3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:22.269408 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-95f649a4-f7e1-4568-8f1c-fa2498dff3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:22.276445 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-95f649a4-f7e1-4568-8f1c-fa2498dff3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:22.277075 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-95f649a4-f7e1-4568-8f1c-fa2498dff3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:22.277531 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-95f649a4-f7e1-4568-8f1c-fa2498dff3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:22.278367 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-95f649a4-f7e1-4568-8f1c-fa2498dff3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:22.278827 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-95f649a4-f7e1-4568-8f1c-fa2498dff3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:22.280290 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-95f649a4-f7e1-4568-8f1c-fa2498dff3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:22.547886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-95f649a4-f7e1-4568-8f1c-fa2498dff3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:22.560453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-95f649a4-f7e1-4568-8f1c-fa2498dff3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:22.562726 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-95f649a4-f7e1-4568-8f1c-fa2498dff3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:22.563893 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-95f649a4-f7e1-4568-8f1c-fa2498dff3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1408 microversion: 2.20 time: 0.299023 Oct 27 17:37:22.565100 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 368/768] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:22 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1408 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:37:22.943059 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:37:22.947991 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-382bac3f-b850-44b5-8508-d2a6d2422d53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:22.948807 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-382bac3f-b850-44b5-8508-d2a6d2422d53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:22.956685 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-382bac3f-b850-44b5-8508-d2a6d2422d53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:22.957439 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-382bac3f-b850-44b5-8508-d2a6d2422d53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:22.957951 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-382bac3f-b850-44b5-8508-d2a6d2422d53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:22.958767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-382bac3f-b850-44b5-8508-d2a6d2422d53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:22.959469 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-382bac3f-b850-44b5-8508-d2a6d2422d53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:22.959997 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-382bac3f-b850-44b5-8508-d2a6d2422d53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:23.024579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-3cf2bfce-9be3-418f-92f9-355e4e07542b req-4ad083e5-7c34-4702-a70e-0612801dcc9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef8a04a-8ed9-43bd-8a43-8ed991b5d746", "tag": "e44c2473-a49a-4e38-91e6-b32e6e8065d8"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:23.034918 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-3cf2bfce-9be3-418f-92f9-355e4e07542b req-4ad083e5-7c34-4702-a70e-0612801dcc9b service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:23.035855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-3cf2bfce-9be3-418f-92f9-355e4e07542b req-4ad083e5-7c34-4702-a70e-0612801dcc9b service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:23.038300 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-3cf2bfce-9be3-418f-92f9-355e4e07542b req-4ad083e5-7c34-4702-a70e-0612801dcc9b service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:23.047272 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-3cf2bfce-9be3-418f-92f9-355e4e07542b req-4ad083e5-7c34-4702-a70e-0612801dcc9b service nova] Creating event network-changed:e44c2473-a49a-4e38-91e6-b32e6e8065d8 for instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 on hv-cinder-86283 Oct 27 17:37:23.052256 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-3cf2bfce-9be3-418f-92f9-355e4e07542b req-4ad083e5-7c34-4702-a70e-0612801dcc9b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031220 Oct 27 17:37:23.052927 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 369/769] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:37:23.213430 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-382bac3f-b850-44b5-8508-d2a6d2422d53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:23.221005 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-382bac3f-b850-44b5-8508-d2a6d2422d53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1367 microversion: 2.1 time: 0.278814 Oct 27 17:37:23.221575 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 401/770] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:22 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:23.590335 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-bf9b48fb-5aec-4d8c-8428-75679db72710 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:23.591028 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-bf9b48fb-5aec-4d8c-8428-75679db72710 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:23.597057 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bf9b48fb-5aec-4d8c-8428-75679db72710 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:23.597534 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bf9b48fb-5aec-4d8c-8428-75679db72710 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:23.597958 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bf9b48fb-5aec-4d8c-8428-75679db72710 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:23.598629 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bf9b48fb-5aec-4d8c-8428-75679db72710 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:23.599070 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bf9b48fb-5aec-4d8c-8428-75679db72710 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:23.599481 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bf9b48fb-5aec-4d8c-8428-75679db72710 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:23.739104 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-bf9b48fb-5aec-4d8c-8428-75679db72710 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:23.747119 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-bf9b48fb-5aec-4d8c-8428-75679db72710 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:23.748725 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-bf9b48fb-5aec-4d8c-8428-75679db72710 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:23.749934 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-bf9b48fb-5aec-4d8c-8428-75679db72710 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1408 microversion: 2.20 time: 0.163832 Oct 27 17:37:23.750486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 370/771] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:23 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:37:24.244601 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d1da1b58-ed34-4f45-9a06-58b23d304b8d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:24.245417 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d1da1b58-ed34-4f45-9a06-58b23d304b8d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:24.252040 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1da1b58-ed34-4f45-9a06-58b23d304b8d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:24.252526 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1da1b58-ed34-4f45-9a06-58b23d304b8d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:24.252961 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1da1b58-ed34-4f45-9a06-58b23d304b8d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:24.253669 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1da1b58-ed34-4f45-9a06-58b23d304b8d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:24.254121 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1da1b58-ed34-4f45-9a06-58b23d304b8d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:24.254552 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1da1b58-ed34-4f45-9a06-58b23d304b8d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:24.629123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d1da1b58-ed34-4f45-9a06-58b23d304b8d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:24.637588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d1da1b58-ed34-4f45-9a06-58b23d304b8d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1367 microversion: 2.1 time: 0.396932 Oct 27 17:37:24.638411 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 402/772] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:24 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1367 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:24.774467 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-1a307e8f-98d0-4fa4-b382-dec077a54214 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:24.775209 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-1a307e8f-98d0-4fa4-b382-dec077a54214 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:24.782278 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1a307e8f-98d0-4fa4-b382-dec077a54214 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:24.782876 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1a307e8f-98d0-4fa4-b382-dec077a54214 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:24.783571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1a307e8f-98d0-4fa4-b382-dec077a54214 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:24.784366 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1a307e8f-98d0-4fa4-b382-dec077a54214 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:24.784814 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1a307e8f-98d0-4fa4-b382-dec077a54214 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:24.785230 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1a307e8f-98d0-4fa4-b382-dec077a54214 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:25.012084 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1a307e8f-98d0-4fa4-b382-dec077a54214 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:25.021460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1a307e8f-98d0-4fa4-b382-dec077a54214 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:25.023191 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1a307e8f-98d0-4fa4-b382-dec077a54214 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:25.024714 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-1a307e8f-98d0-4fa4-b382-dec077a54214 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1408 microversion: 2.20 time: 0.254254 Oct 27 17:37:25.037041 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 371/773] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:24 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:37:25.665629 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c66fad6a-dbed-426c-adc2-a9fa7637918d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:25.666790 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c66fad6a-dbed-426c-adc2-a9fa7637918d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:25.675408 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c66fad6a-dbed-426c-adc2-a9fa7637918d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:25.675408 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c66fad6a-dbed-426c-adc2-a9fa7637918d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:25.675696 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c66fad6a-dbed-426c-adc2-a9fa7637918d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:25.676427 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c66fad6a-dbed-426c-adc2-a9fa7637918d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:25.676901 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c66fad6a-dbed-426c-adc2-a9fa7637918d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:25.677325 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c66fad6a-dbed-426c-adc2-a9fa7637918d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:25.898845 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c66fad6a-dbed-426c-adc2-a9fa7637918d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:25.906661 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c66fad6a-dbed-426c-adc2-a9fa7637918d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1367 microversion: 2.1 time: 0.247904 Oct 27 17:37:25.923015 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 403/774] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:25 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:26.051530 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d3414093-ff68-4a70-90d1-036a958e527e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:26.052881 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d3414093-ff68-4a70-90d1-036a958e527e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:26.060270 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3414093-ff68-4a70-90d1-036a958e527e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:26.060903 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3414093-ff68-4a70-90d1-036a958e527e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:26.061345 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3414093-ff68-4a70-90d1-036a958e527e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:26.062049 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3414093-ff68-4a70-90d1-036a958e527e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:26.062698 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3414093-ff68-4a70-90d1-036a958e527e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:26.062919 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d3414093-ff68-4a70-90d1-036a958e527e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:26.319788 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d3414093-ff68-4a70-90d1-036a958e527e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:26.328393 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d3414093-ff68-4a70-90d1-036a958e527e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:26.330108 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d3414093-ff68-4a70-90d1-036a958e527e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:26.332399 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d3414093-ff68-4a70-90d1-036a958e527e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1408 microversion: 2.20 time: 0.284386 Oct 27 17:37:26.353656 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 372/775] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:26 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1408 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:37:26.929861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-865d714e-8b63-4156-b48a-239cb3a4c69c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:26.930509 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-865d714e-8b63-4156-b48a-239cb3a4c69c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:26.937457 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-865d714e-8b63-4156-b48a-239cb3a4c69c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:26.937942 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-865d714e-8b63-4156-b48a-239cb3a4c69c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:26.938378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-865d714e-8b63-4156-b48a-239cb3a4c69c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:26.939069 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-865d714e-8b63-4156-b48a-239cb3a4c69c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:26.939524 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-865d714e-8b63-4156-b48a-239cb3a4c69c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:26.939976 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-865d714e-8b63-4156-b48a-239cb3a4c69c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:27.142300 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-865d714e-8b63-4156-b48a-239cb3a4c69c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:27.149894 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-865d714e-8b63-4156-b48a-239cb3a4c69c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1367 microversion: 2.1 time: 0.223877 Oct 27 17:37:27.150463 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 404/776] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:26 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:27.359331 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-209cc0f0-0c59-4913-924a-e8e4d4c9d507 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:27.360310 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-209cc0f0-0c59-4913-924a-e8e4d4c9d507 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:27.367025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-209cc0f0-0c59-4913-924a-e8e4d4c9d507 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:27.367505 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-209cc0f0-0c59-4913-924a-e8e4d4c9d507 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:27.368041 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-209cc0f0-0c59-4913-924a-e8e4d4c9d507 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:27.369008 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-209cc0f0-0c59-4913-924a-e8e4d4c9d507 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:27.369641 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-209cc0f0-0c59-4913-924a-e8e4d4c9d507 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:27.370064 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-209cc0f0-0c59-4913-924a-e8e4d4c9d507 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:27.465878 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-d131edf0-68de-4bca-9ffa-41e91b9f9406 req-cfb7f06e-da20-4dfd-882a-d88e3d6736be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be393ea8-0e26-4c60-8b50-bab24362d246", "name": "network-vif-plugged", "status": "completed", "tag": "cf522c5e-a944-4450-8095-8875d39f901e"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:27.481415 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-d131edf0-68de-4bca-9ffa-41e91b9f9406 req-cfb7f06e-da20-4dfd-882a-d88e3d6736be service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:27.482015 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-d131edf0-68de-4bca-9ffa-41e91b9f9406 req-cfb7f06e-da20-4dfd-882a-d88e3d6736be service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:27.483260 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-d131edf0-68de-4bca-9ffa-41e91b9f9406 req-cfb7f06e-da20-4dfd-882a-d88e3d6736be service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:27.495423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-d131edf0-68de-4bca-9ffa-41e91b9f9406 req-cfb7f06e-da20-4dfd-882a-d88e3d6736be service nova] Creating event network-vif-plugged:cf522c5e-a944-4450-8095-8875d39f901e for instance be393ea8-0e26-4c60-8b50-bab24362d246 on hv-cinder-86283 Oct 27 17:37:27.501757 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-d131edf0-68de-4bca-9ffa-41e91b9f9406 req-cfb7f06e-da20-4dfd-882a-d88e3d6736be service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112343 Oct 27 17:37:27.502539 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 405/777] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:37:27.527919 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-209cc0f0-0c59-4913-924a-e8e4d4c9d507 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:27.536537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-209cc0f0-0c59-4913-924a-e8e4d4c9d507 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:27.538098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-209cc0f0-0c59-4913-924a-e8e4d4c9d507 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:27.539305 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-209cc0f0-0c59-4913-924a-e8e4d4c9d507 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1408 microversion: 2.20 time: 0.184662 Oct 27 17:37:27.540129 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 373/778] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:27 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:37:28.174283 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-70325a0d-a970-4199-ac05-1e6476e42c5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:28.176489 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-70325a0d-a970-4199-ac05-1e6476e42c5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:28.182988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=14 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:37:28.186389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-70325a0d-a970-4199-ac05-1e6476e42c5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:28.186979 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-70325a0d-a970-4199-ac05-1e6476e42c5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:28.187569 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-70325a0d-a970-4199-ac05-1e6476e42c5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:28.188389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-70325a0d-a970-4199-ac05-1e6476e42c5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:28.188931 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-70325a0d-a970-4199-ac05-1e6476e42c5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:28.189447 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-70325a0d-a970-4199-ac05-1e6476e42c5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:28.426603 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-70325a0d-a970-4199-ac05-1e6476e42c5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:28.437704 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-70325a0d-a970-4199-ac05-1e6476e42c5c tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1367 microversion: 2.1 time: 0.267994 Oct 27 17:37:28.438868 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 406/779] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:28 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:28.572294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-10261212-1d57-4049-aa16-22c5644ecc5d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:28.573547 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-10261212-1d57-4049-aa16-22c5644ecc5d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:28.576588 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=2 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:37:28.578067 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=16 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:37:28.589663 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10261212-1d57-4049-aa16-22c5644ecc5d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:28.590361 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10261212-1d57-4049-aa16-22c5644ecc5d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:28.590891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10261212-1d57-4049-aa16-22c5644ecc5d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:28.592277 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10261212-1d57-4049-aa16-22c5644ecc5d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:28.592958 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10261212-1d57-4049-aa16-22c5644ecc5d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:28.594056 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10261212-1d57-4049-aa16-22c5644ecc5d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:28.741895 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-10261212-1d57-4049-aa16-22c5644ecc5d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:28.754281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-10261212-1d57-4049-aa16-22c5644ecc5d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:28.755828 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-10261212-1d57-4049-aa16-22c5644ecc5d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:28.757746 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-10261212-1d57-4049-aa16-22c5644ecc5d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1408 microversion: 2.20 time: 0.195277 Oct 27 17:37:28.759686 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 374/780] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:28 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:37:29.461324 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-680633fb-68a0-4821-972c-60efc47d95e4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:29.461928 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-680633fb-68a0-4821-972c-60efc47d95e4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:29.475576 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-680633fb-68a0-4821-972c-60efc47d95e4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:29.476322 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-680633fb-68a0-4821-972c-60efc47d95e4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:29.476759 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-680633fb-68a0-4821-972c-60efc47d95e4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:29.477514 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-680633fb-68a0-4821-972c-60efc47d95e4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:29.477996 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-680633fb-68a0-4821-972c-60efc47d95e4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:29.478471 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-680633fb-68a0-4821-972c-60efc47d95e4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:29.785184 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-bdd41d5f-769d-4457-b2e0-346b6689bf44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:29.785787 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-bdd41d5f-769d-4457-b2e0-346b6689bf44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:29.792482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bdd41d5f-769d-4457-b2e0-346b6689bf44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:29.792948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bdd41d5f-769d-4457-b2e0-346b6689bf44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:29.793370 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bdd41d5f-769d-4457-b2e0-346b6689bf44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:29.794063 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bdd41d5f-769d-4457-b2e0-346b6689bf44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:29.794528 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bdd41d5f-769d-4457-b2e0-346b6689bf44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:29.794945 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bdd41d5f-769d-4457-b2e0-346b6689bf44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:30.047010 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-bdd41d5f-769d-4457-b2e0-346b6689bf44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:30.055229 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-bdd41d5f-769d-4457-b2e0-346b6689bf44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:30.063980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-bdd41d5f-769d-4457-b2e0-346b6689bf44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:30.073188 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-bdd41d5f-769d-4457-b2e0-346b6689bf44 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1408 microversion: 2.20 time: 0.291902 Oct 27 17:37:30.073879 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 375/781] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:29 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1408 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:37:30.085662 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-680633fb-68a0-4821-972c-60efc47d95e4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:30.101291 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-680633fb-68a0-4821-972c-60efc47d95e4 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1367 microversion: 2.1 time: 0.641831 Oct 27 17:37:30.102829 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 407/782] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:29 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1367 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:31.098444 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-be2acaab-de71-47db-974a-9bdf64541fff tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:31.099637 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-be2acaab-de71-47db-974a-9bdf64541fff tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:31.107472 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-be2acaab-de71-47db-974a-9bdf64541fff tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:31.108217 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-be2acaab-de71-47db-974a-9bdf64541fff tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:31.108858 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-be2acaab-de71-47db-974a-9bdf64541fff tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:31.109741 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-be2acaab-de71-47db-974a-9bdf64541fff tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:31.110393 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-be2acaab-de71-47db-974a-9bdf64541fff tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:31.111015 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-be2acaab-de71-47db-974a-9bdf64541fff tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:31.124874 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f95a6448-d205-455a-86f6-37f4d5dd8135 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:31.125586 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f95a6448-d205-455a-86f6-37f4d5dd8135 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:31.132885 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f95a6448-d205-455a-86f6-37f4d5dd8135 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:31.133680 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f95a6448-d205-455a-86f6-37f4d5dd8135 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:31.134320 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f95a6448-d205-455a-86f6-37f4d5dd8135 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:31.135223 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f95a6448-d205-455a-86f6-37f4d5dd8135 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:31.135911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f95a6448-d205-455a-86f6-37f4d5dd8135 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:31.136527 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f95a6448-d205-455a-86f6-37f4d5dd8135 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:31.307997 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-be2acaab-de71-47db-974a-9bdf64541fff tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:31.311577 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f95a6448-d205-455a-86f6-37f4d5dd8135 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:31.319788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f95a6448-d205-455a-86f6-37f4d5dd8135 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1367 microversion: 2.1 time: 0.199239 Oct 27 17:37:31.323765 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-be2acaab-de71-47db-974a-9bdf64541fff tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:31.323937 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-be2acaab-de71-47db-974a-9bdf64541fff tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:31.324350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 408/783] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:31 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:37:31.327405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-be2acaab-de71-47db-974a-9bdf64541fff tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1408 microversion: 2.20 time: 0.232818 Oct 27 17:37:31.332768 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 376/784] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:31 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:37:31.605012 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-3015e721-2b96-4397-a964-47e092aa41c9 req-b4daabda-2034-4518-9e67-8dcf65770eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef8a04a-8ed9-43bd-8a43-8ed991b5d746", "name": "network-vif-plugged", "status": "completed", "tag": "e44c2473-a49a-4e38-91e6-b32e6e8065d8"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:31.614931 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-3015e721-2b96-4397-a964-47e092aa41c9 req-b4daabda-2034-4518-9e67-8dcf65770eac service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:31.615439 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-3015e721-2b96-4397-a964-47e092aa41c9 req-b4daabda-2034-4518-9e67-8dcf65770eac service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:31.615883 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-3015e721-2b96-4397-a964-47e092aa41c9 req-b4daabda-2034-4518-9e67-8dcf65770eac service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:31.628527 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-3015e721-2b96-4397-a964-47e092aa41c9 req-b4daabda-2034-4518-9e67-8dcf65770eac service nova] Creating event network-vif-plugged:e44c2473-a49a-4e38-91e6-b32e6e8065d8 for instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 on hv-cinder-86283 Oct 27 17:37:31.633976 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-3015e721-2b96-4397-a964-47e092aa41c9 req-b4daabda-2034-4518-9e67-8dcf65770eac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032367 Oct 27 17:37:31.635101 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 409/785] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:32.347314 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-66765597-751f-4e1b-9ddd-fbf455f10379 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:32.347942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-66765597-751f-4e1b-9ddd-fbf455f10379 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:32.354587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66765597-751f-4e1b-9ddd-fbf455f10379 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:32.355059 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66765597-751f-4e1b-9ddd-fbf455f10379 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:32.355484 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66765597-751f-4e1b-9ddd-fbf455f10379 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:32.356192 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66765597-751f-4e1b-9ddd-fbf455f10379 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:32.356637 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66765597-751f-4e1b-9ddd-fbf455f10379 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:32.357673 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66765597-751f-4e1b-9ddd-fbf455f10379 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:32.359999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d357ea42-1a69-41eb-bd2c-7bfcdcbb6b32 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:32.360827 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d357ea42-1a69-41eb-bd2c-7bfcdcbb6b32 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:32.366861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d357ea42-1a69-41eb-bd2c-7bfcdcbb6b32 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:32.367335 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d357ea42-1a69-41eb-bd2c-7bfcdcbb6b32 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:32.367799 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d357ea42-1a69-41eb-bd2c-7bfcdcbb6b32 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:32.368492 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d357ea42-1a69-41eb-bd2c-7bfcdcbb6b32 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:32.368944 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d357ea42-1a69-41eb-bd2c-7bfcdcbb6b32 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:32.369364 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d357ea42-1a69-41eb-bd2c-7bfcdcbb6b32 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:32.387195 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:37:32.506341 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-66765597-751f-4e1b-9ddd-fbf455f10379 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:32.515481 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-66765597-751f-4e1b-9ddd-fbf455f10379 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1557 microversion: 2.1 time: 0.171850 Oct 27 17:37:32.515806 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d357ea42-1a69-41eb-bd2c-7bfcdcbb6b32 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:32.516365 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 377/786] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:32 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1557 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:32.524146 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d357ea42-1a69-41eb-bd2c-7bfcdcbb6b32 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:32.525659 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d357ea42-1a69-41eb-bd2c-7bfcdcbb6b32 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:32.526868 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d357ea42-1a69-41eb-bd2c-7bfcdcbb6b32 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1408 microversion: 2.20 time: 0.172311 Oct 27 17:37:32.527495 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 410/787] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:32 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:37:32.543132 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f6e46f6b-982e-4920-860d-053db3d2b9d2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:32.543624 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-f6e46f6b-982e-4920-860d-053db3d2b9d2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:32.551276 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f6e46f6b-982e-4920-860d-053db3d2b9d2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:32.551808 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f6e46f6b-982e-4920-860d-053db3d2b9d2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:32.552368 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f6e46f6b-982e-4920-860d-053db3d2b9d2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:32.553061 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f6e46f6b-982e-4920-860d-053db3d2b9d2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:32.553504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f6e46f6b-982e-4920-860d-053db3d2b9d2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:32.553923 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f6e46f6b-982e-4920-860d-053db3d2b9d2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:32.657623 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f6e46f6b-982e-4920-860d-053db3d2b9d2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118316 Oct 27 17:37:32.658536 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 378/788] 10.222.0.36 () {58 vars in 1275 bytes} [Thu Oct 27 17:37:32 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:33.555545 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-cece75ba-fd9b-486c-94a0-82c4e44510d4 req-b0a7e923-1300-434b-9d50-ff2e3f1de733 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be393ea8-0e26-4c60-8b50-bab24362d246", "tag": "cf522c5e-a944-4450-8095-8875d39f901e"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:33.558853 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f30dc87c-159a-46de-91d6-6d8460572a4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:33.559465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f30dc87c-159a-46de-91d6-6d8460572a4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:33.566986 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f30dc87c-159a-46de-91d6-6d8460572a4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:33.567624 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f30dc87c-159a-46de-91d6-6d8460572a4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:33.568086 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f30dc87c-159a-46de-91d6-6d8460572a4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:33.568778 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f30dc87c-159a-46de-91d6-6d8460572a4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:33.569563 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f30dc87c-159a-46de-91d6-6d8460572a4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:33.569679 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f30dc87c-159a-46de-91d6-6d8460572a4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:33.573062 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-cece75ba-fd9b-486c-94a0-82c4e44510d4 req-b0a7e923-1300-434b-9d50-ff2e3f1de733 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:33.574746 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-cece75ba-fd9b-486c-94a0-82c4e44510d4 req-b0a7e923-1300-434b-9d50-ff2e3f1de733 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:33.574746 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-cece75ba-fd9b-486c-94a0-82c4e44510d4 req-b0a7e923-1300-434b-9d50-ff2e3f1de733 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:33.587010 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-cece75ba-fd9b-486c-94a0-82c4e44510d4 req-b0a7e923-1300-434b-9d50-ff2e3f1de733 service nova] Creating event network-changed:cf522c5e-a944-4450-8095-8875d39f901e for instance be393ea8-0e26-4c60-8b50-bab24362d246 on hv-cinder-86283 Oct 27 17:37:33.592883 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-cece75ba-fd9b-486c-94a0-82c4e44510d4 req-b0a7e923-1300-434b-9d50-ff2e3f1de733 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041374 Oct 27 17:37:33.593476 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 379/789] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:33.703761 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f30dc87c-159a-46de-91d6-6d8460572a4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:33.712200 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f30dc87c-159a-46de-91d6-6d8460572a4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:33.713772 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f30dc87c-159a-46de-91d6-6d8460572a4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:33.714930 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f30dc87c-159a-46de-91d6-6d8460572a4c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1408 microversion: 2.20 time: 0.166378 Oct 27 17:37:33.723921 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 411/790] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:33 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:37:34.742007 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-dd7c6895-d6f0-4b1e-afeb-09f696bdaa6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:34.742703 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-dd7c6895-d6f0-4b1e-afeb-09f696bdaa6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:34.749096 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dd7c6895-d6f0-4b1e-afeb-09f696bdaa6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:34.749601 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dd7c6895-d6f0-4b1e-afeb-09f696bdaa6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:34.750031 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dd7c6895-d6f0-4b1e-afeb-09f696bdaa6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:34.750714 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dd7c6895-d6f0-4b1e-afeb-09f696bdaa6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:34.751169 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dd7c6895-d6f0-4b1e-afeb-09f696bdaa6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:34.751586 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-dd7c6895-d6f0-4b1e-afeb-09f696bdaa6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:34.935664 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-dd7c6895-d6f0-4b1e-afeb-09f696bdaa6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:34.943954 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-dd7c6895-d6f0-4b1e-afeb-09f696bdaa6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:34.945398 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-dd7c6895-d6f0-4b1e-afeb-09f696bdaa6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:34.946559 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-dd7c6895-d6f0-4b1e-afeb-09f696bdaa6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1599 microversion: 2.20 time: 0.209445 Oct 27 17:37:34.947122 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 380/791] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:37:34 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:37:34.971370 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-91b3ba29-875e-4c91-b614-4df426ff10a1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:34.971943 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-91b3ba29-875e-4c91-b614-4df426ff10a1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:34.978607 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-91b3ba29-875e-4c91-b614-4df426ff10a1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:34.979109 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-91b3ba29-875e-4c91-b614-4df426ff10a1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:34.979538 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-91b3ba29-875e-4c91-b614-4df426ff10a1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:34.980259 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-91b3ba29-875e-4c91-b614-4df426ff10a1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:34.980707 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-91b3ba29-875e-4c91-b614-4df426ff10a1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:34.981127 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-91b3ba29-875e-4c91-b614-4df426ff10a1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:35.058433 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-91b3ba29-875e-4c91-b614-4df426ff10a1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090958 Oct 27 17:37:35.059145 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 412/792] 10.222.0.36 () {60 vars in 1316 bytes} [Thu Oct 27 17:37:34 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:37:35.965212 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-bca11007-1d50-410d-849f-07205c52ab22 req-944ed76f-b0ac-4ad9-a8d8-2519751385a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef8a04a-8ed9-43bd-8a43-8ed991b5d746", "tag": "e44c2473-a49a-4e38-91e6-b32e6e8065d8"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:35.974652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-bca11007-1d50-410d-849f-07205c52ab22 req-944ed76f-b0ac-4ad9-a8d8-2519751385a9 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:35.975388 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-bca11007-1d50-410d-849f-07205c52ab22 req-944ed76f-b0ac-4ad9-a8d8-2519751385a9 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:35.975856 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-bca11007-1d50-410d-849f-07205c52ab22 req-944ed76f-b0ac-4ad9-a8d8-2519751385a9 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:35.986734 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-bca11007-1d50-410d-849f-07205c52ab22 req-944ed76f-b0ac-4ad9-a8d8-2519751385a9 service nova] Creating event network-changed:e44c2473-a49a-4e38-91e6-b32e6e8065d8 for instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 on hv-cinder-86283 Oct 27 17:37:35.991529 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-bca11007-1d50-410d-849f-07205c52ab22 req-944ed76f-b0ac-4ad9-a8d8-2519751385a9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029976 Oct 27 17:37:35.992354 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 381/793] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:48.507833 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:37:48.508585 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=12 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:37:48.513056 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-588bc260-cbc7-4b0d-a4db-4641aae8dd8e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:48.513582 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-588bc260-cbc7-4b0d-a4db-4641aae8dd8e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:48.520491 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-588bc260-cbc7-4b0d-a4db-4641aae8dd8e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:48.520971 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-588bc260-cbc7-4b0d-a4db-4641aae8dd8e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:48.521407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-588bc260-cbc7-4b0d-a4db-4641aae8dd8e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:48.522091 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-588bc260-cbc7-4b0d-a4db-4641aae8dd8e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:48.522541 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-588bc260-cbc7-4b0d-a4db-4641aae8dd8e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:48.522965 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-588bc260-cbc7-4b0d-a4db-4641aae8dd8e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:48.546434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.objects.instance [None req-588bc260-cbc7-4b0d-a4db-4641aae8dd8e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lazy-loading 'flavor' on Instance uuid 26a883d9-7208-49ab-9775-557bba9f7efd {{(pid=119047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:37:48.615741 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-588bc260-cbc7-4b0d-a4db-4641aae8dd8e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "POST /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd/action" status: 202 len: 0 microversion: 2.1 time: 0.109099 Oct 27 17:37:48.616374 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 413/794] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Oct 27 17:37:48 2022] POST /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:37:48.623141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:37:48.623906 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=94 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:37:48.628358 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2b42c60e-a510-4837-92d7-9f88bf37f0fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:48.629054 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2b42c60e-a510-4837-92d7-9f88bf37f0fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:48.637098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2b42c60e-a510-4837-92d7-9f88bf37f0fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:48.638197 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2b42c60e-a510-4837-92d7-9f88bf37f0fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:48.638630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2b42c60e-a510-4837-92d7-9f88bf37f0fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:48.639318 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2b42c60e-a510-4837-92d7-9f88bf37f0fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:48.639791 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2b42c60e-a510-4837-92d7-9f88bf37f0fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:48.640210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2b42c60e-a510-4837-92d7-9f88bf37f0fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:48.768889 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2b42c60e-a510-4837-92d7-9f88bf37f0fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:48.776724 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2b42c60e-a510-4837-92d7-9f88bf37f0fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.155792 Oct 27 17:37:48.777285 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 382/795] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:48 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:49.013741 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-24ba0b8b-e4b2-43fe-b1b1-b7c310b674de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:49.014314 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-24ba0b8b-e4b2-43fe-b1b1-b7c310b674de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:49.020411 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-24ba0b8b-e4b2-43fe-b1b1-b7c310b674de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:49.020831 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-24ba0b8b-e4b2-43fe-b1b1-b7c310b674de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:49.021264 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-24ba0b8b-e4b2-43fe-b1b1-b7c310b674de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:49.021940 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-24ba0b8b-e4b2-43fe-b1b1-b7c310b674de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:49.022389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-24ba0b8b-e4b2-43fe-b1b1-b7c310b674de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:49.022807 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-24ba0b8b-e4b2-43fe-b1b1-b7c310b674de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:49.103593 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.objects.instance [None req-24ba0b8b-e4b2-43fe-b1b1-b7c310b674de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lazy-loading 'services' on Instance uuid 41584d40-839e-4610-9c2b-7291f0d8d790 {{(pid=119047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:37:49.175311 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-24ba0b8b-e4b2-43fe-b1b1-b7c310b674de tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "DELETE /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-volume_attachments/f5f57023-dd35-46f2-a499-a0c3d48f52c8" status: 202 len: 0 microversion: 2.1 time: 0.165936 Oct 27 17:37:49.175989 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 414/796] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Oct 27 17:37:49 2022] DELETE /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-volume_attachments/f5f57023-dd35-46f2-a499-a0c3d48f52c8 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:37:49.184922 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-c5c7986e-cf37-418c-89a1-9234d87f8c68 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:49.187181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c5c7986e-cf37-418c-89a1-9234d87f8c68 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:49.193589 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c5c7986e-cf37-418c-89a1-9234d87f8c68 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:49.194080 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c5c7986e-cf37-418c-89a1-9234d87f8c68 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:49.194510 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c5c7986e-cf37-418c-89a1-9234d87f8c68 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:49.195289 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c5c7986e-cf37-418c-89a1-9234d87f8c68 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:49.195835 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c5c7986e-cf37-418c-89a1-9234d87f8c68 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:49.196268 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c5c7986e-cf37-418c-89a1-9234d87f8c68 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:49.225853 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-c5c7986e-cf37-418c-89a1-9234d87f8c68 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045477 Oct 27 17:37:49.226476 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 383/797] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:37:49 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:49.800778 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-7f2b23b2-3bdd-4f8f-9407-bd62b4acb03a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:49.801480 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-7f2b23b2-3bdd-4f8f-9407-bd62b4acb03a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:49.807670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f2b23b2-3bdd-4f8f-9407-bd62b4acb03a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:49.808191 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f2b23b2-3bdd-4f8f-9407-bd62b4acb03a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:49.808653 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f2b23b2-3bdd-4f8f-9407-bd62b4acb03a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:49.809341 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f2b23b2-3bdd-4f8f-9407-bd62b4acb03a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:49.809792 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f2b23b2-3bdd-4f8f-9407-bd62b4acb03a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:49.810216 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7f2b23b2-3bdd-4f8f-9407-bd62b4acb03a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:49.944116 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7f2b23b2-3bdd-4f8f-9407-bd62b4acb03a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:49.952375 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-7f2b23b2-3bdd-4f8f-9407-bd62b4acb03a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.156392 Oct 27 17:37:49.952938 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 415/798] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:49 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:50.238674 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-81ccb93e-bebc-4e8b-b45c-f672863293ad tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:50.240890 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-81ccb93e-bebc-4e8b-b45c-f672863293ad tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:50.247999 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81ccb93e-bebc-4e8b-b45c-f672863293ad tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:50.248492 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81ccb93e-bebc-4e8b-b45c-f672863293ad tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:50.248928 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81ccb93e-bebc-4e8b-b45c-f672863293ad tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:50.249631 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81ccb93e-bebc-4e8b-b45c-f672863293ad tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:50.250089 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81ccb93e-bebc-4e8b-b45c-f672863293ad tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:50.250514 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81ccb93e-bebc-4e8b-b45c-f672863293ad tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:50.281088 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-81ccb93e-bebc-4e8b-b45c-f672863293ad tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046370 Oct 27 17:37:50.281645 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 384/799] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:37:50 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:50.976336 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f055222e-4de3-4893-8001-689f6a7284fc tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:50.976943 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f055222e-4de3-4893-8001-689f6a7284fc tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:50.983877 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f055222e-4de3-4893-8001-689f6a7284fc tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:50.984356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f055222e-4de3-4893-8001-689f6a7284fc tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:50.984784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f055222e-4de3-4893-8001-689f6a7284fc tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:50.985463 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f055222e-4de3-4893-8001-689f6a7284fc tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:50.985910 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f055222e-4de3-4893-8001-689f6a7284fc tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:50.986326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f055222e-4de3-4893-8001-689f6a7284fc tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:51.120965 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f055222e-4de3-4893-8001-689f6a7284fc tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:51.128574 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f055222e-4de3-4893-8001-689f6a7284fc tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.156447 Oct 27 17:37:51.129135 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 416/800] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:50 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:51.293328 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-61c83534-2397-4271-a535-907601eb92eb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:51.295532 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-61c83534-2397-4271-a535-907601eb92eb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:51.301856 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-61c83534-2397-4271-a535-907601eb92eb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:51.302331 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-61c83534-2397-4271-a535-907601eb92eb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:51.302759 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-61c83534-2397-4271-a535-907601eb92eb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:51.303444 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-61c83534-2397-4271-a535-907601eb92eb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:51.303934 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-61c83534-2397-4271-a535-907601eb92eb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:51.304375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-61c83534-2397-4271-a535-907601eb92eb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:51.333238 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-61c83534-2397-4271-a535-907601eb92eb tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043808 Oct 27 17:37:51.333796 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 385/801] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:37:51 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 17:37:51.408672 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-bfea4e12-9c46-459b-9349-7a33a47ccfa2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:51.409159 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-bfea4e12-9c46-459b-9349-7a33a47ccfa2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:51.414992 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bfea4e12-9c46-459b-9349-7a33a47ccfa2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:51.415467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bfea4e12-9c46-459b-9349-7a33a47ccfa2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:51.415933 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bfea4e12-9c46-459b-9349-7a33a47ccfa2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:51.416607 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bfea4e12-9c46-459b-9349-7a33a47ccfa2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:51.417087 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bfea4e12-9c46-459b-9349-7a33a47ccfa2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:51.417619 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bfea4e12-9c46-459b-9349-7a33a47ccfa2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:51.442607 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-bfea4e12-9c46-459b-9349-7a33a47ccfa2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Going to try to terminate instance {{(pid=119047) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:37:51.514852 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-bfea4e12-9c46-459b-9349-7a33a47ccfa2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "DELETE /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 204 len: 0 microversion: 2.1 time: 0.109760 Oct 27 17:37:51.515847 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 417/802] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:37:51 2022] DELETE /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:37:51.524384 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8dc05668-61c5-4f82-ba3d-ef9a6b7fae35 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:51.524989 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8dc05668-61c5-4f82-ba3d-ef9a6b7fae35 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:51.530929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8dc05668-61c5-4f82-ba3d-ef9a6b7fae35 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:51.531406 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8dc05668-61c5-4f82-ba3d-ef9a6b7fae35 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:51.531881 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8dc05668-61c5-4f82-ba3d-ef9a6b7fae35 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:51.532558 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8dc05668-61c5-4f82-ba3d-ef9a6b7fae35 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:51.533005 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8dc05668-61c5-4f82-ba3d-ef9a6b7fae35 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:51.533432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8dc05668-61c5-4f82-ba3d-ef9a6b7fae35 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:51.664441 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8dc05668-61c5-4f82-ba3d-ef9a6b7fae35 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:51.672098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8dc05668-61c5-4f82-ba3d-ef9a6b7fae35 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1688 microversion: 2.1 time: 0.151580 Oct 27 17:37:51.672663 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 386/803] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:51 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:52.152031 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-93a89f82-671b-49b7-b981-b113bfeea635 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:52.152743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-93a89f82-671b-49b7-b981-b113bfeea635 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:52.159278 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93a89f82-671b-49b7-b981-b113bfeea635 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:52.159788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93a89f82-671b-49b7-b981-b113bfeea635 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:52.160220 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93a89f82-671b-49b7-b981-b113bfeea635 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:52.160894 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93a89f82-671b-49b7-b981-b113bfeea635 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:52.161342 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93a89f82-671b-49b7-b981-b113bfeea635 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:52.161754 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93a89f82-671b-49b7-b981-b113bfeea635 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:52.301086 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-93a89f82-671b-49b7-b981-b113bfeea635 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:52.309176 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-93a89f82-671b-49b7-b981-b113bfeea635 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.161414 Oct 27 17:37:52.309745 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 418/804] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:52 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:52.694433 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a78fd67e-1118-487d-a9b8-11e461f3431e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:52.695039 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a78fd67e-1118-487d-a9b8-11e461f3431e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:52.701911 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a78fd67e-1118-487d-a9b8-11e461f3431e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:52.702387 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a78fd67e-1118-487d-a9b8-11e461f3431e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:52.702818 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a78fd67e-1118-487d-a9b8-11e461f3431e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:52.703499 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a78fd67e-1118-487d-a9b8-11e461f3431e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:52.703980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a78fd67e-1118-487d-a9b8-11e461f3431e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:52.704399 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a78fd67e-1118-487d-a9b8-11e461f3431e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:52.831286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a78fd67e-1118-487d-a9b8-11e461f3431e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:52.839165 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a78fd67e-1118-487d-a9b8-11e461f3431e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1688 microversion: 2.1 time: 0.148556 Oct 27 17:37:52.839757 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 387/805] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:52 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:53.332518 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8a9368b7-63e5-4124-aaf5-329d5a9d2f2f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:53.333158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8a9368b7-63e5-4124-aaf5-329d5a9d2f2f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:53.339537 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a9368b7-63e5-4124-aaf5-329d5a9d2f2f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:53.340032 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a9368b7-63e5-4124-aaf5-329d5a9d2f2f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:53.341086 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a9368b7-63e5-4124-aaf5-329d5a9d2f2f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:53.341882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a9368b7-63e5-4124-aaf5-329d5a9d2f2f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:53.342415 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a9368b7-63e5-4124-aaf5-329d5a9d2f2f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:53.342981 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a9368b7-63e5-4124-aaf5-329d5a9d2f2f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:53.471696 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8a9368b7-63e5-4124-aaf5-329d5a9d2f2f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:53.479589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8a9368b7-63e5-4124-aaf5-329d5a9d2f2f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.150968 Oct 27 17:37:53.480173 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 419/806] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:53 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:53.862858 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-77385f59-e02e-4171-9a91-e6fe5469b04a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:53.863457 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-77385f59-e02e-4171-9a91-e6fe5469b04a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:53.869869 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-77385f59-e02e-4171-9a91-e6fe5469b04a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:53.870283 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-77385f59-e02e-4171-9a91-e6fe5469b04a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:53.870707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-77385f59-e02e-4171-9a91-e6fe5469b04a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:53.872187 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-77385f59-e02e-4171-9a91-e6fe5469b04a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:53.872426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-77385f59-e02e-4171-9a91-e6fe5469b04a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:53.873152 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-77385f59-e02e-4171-9a91-e6fe5469b04a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:54.001745 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-77385f59-e02e-4171-9a91-e6fe5469b04a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:54.009427 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-77385f59-e02e-4171-9a91-e6fe5469b04a tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1688 microversion: 2.1 time: 0.150481 Oct 27 17:37:54.009994 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 388/807] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:53 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:54.502283 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-823b5619-f5c0-445e-b3dd-0fc834ac1f95 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:54.502891 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-823b5619-f5c0-445e-b3dd-0fc834ac1f95 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:54.509313 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-823b5619-f5c0-445e-b3dd-0fc834ac1f95 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:54.509792 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-823b5619-f5c0-445e-b3dd-0fc834ac1f95 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:54.510220 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-823b5619-f5c0-445e-b3dd-0fc834ac1f95 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:54.510900 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-823b5619-f5c0-445e-b3dd-0fc834ac1f95 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:54.511349 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-823b5619-f5c0-445e-b3dd-0fc834ac1f95 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:54.511791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-823b5619-f5c0-445e-b3dd-0fc834ac1f95 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:54.642251 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-823b5619-f5c0-445e-b3dd-0fc834ac1f95 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:54.649894 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-823b5619-f5c0-445e-b3dd-0fc834ac1f95 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.151494 Oct 27 17:37:54.650464 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 420/808] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:54 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:55.032839 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7904cf67-2bd6-445b-8df1-b63a03b8635e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:55.033473 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7904cf67-2bd6-445b-8df1-b63a03b8635e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:55.039963 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7904cf67-2bd6-445b-8df1-b63a03b8635e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:55.040453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7904cf67-2bd6-445b-8df1-b63a03b8635e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:55.040890 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7904cf67-2bd6-445b-8df1-b63a03b8635e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:55.041580 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7904cf67-2bd6-445b-8df1-b63a03b8635e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:55.042032 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7904cf67-2bd6-445b-8df1-b63a03b8635e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:55.042456 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7904cf67-2bd6-445b-8df1-b63a03b8635e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:55.175479 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7904cf67-2bd6-445b-8df1-b63a03b8635e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:55.183266 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7904cf67-2bd6-445b-8df1-b63a03b8635e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1688 microversion: 2.1 time: 0.154289 Oct 27 17:37:55.183916 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 389/809] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:55 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:55.673600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-099b5f56-069b-4c55-9112-fdad5005e569 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:55.674208 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-099b5f56-069b-4c55-9112-fdad5005e569 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:55.680566 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-099b5f56-069b-4c55-9112-fdad5005e569 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:55.681042 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-099b5f56-069b-4c55-9112-fdad5005e569 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:55.681472 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-099b5f56-069b-4c55-9112-fdad5005e569 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:55.682152 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-099b5f56-069b-4c55-9112-fdad5005e569 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:55.682600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-099b5f56-069b-4c55-9112-fdad5005e569 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:55.683015 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-099b5f56-069b-4c55-9112-fdad5005e569 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:55.968337 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-099b5f56-069b-4c55-9112-fdad5005e569 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:55.976473 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-099b5f56-069b-4c55-9112-fdad5005e569 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.306580 Oct 27 17:37:55.977358 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 421/810] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:55 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:56.206543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-aa86661d-5c4f-49b9-bd9a-f1137066aff2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:56.207091 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-aa86661d-5c4f-49b9-bd9a-f1137066aff2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:56.213407 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aa86661d-5c4f-49b9-bd9a-f1137066aff2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:56.213894 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aa86661d-5c4f-49b9-bd9a-f1137066aff2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:56.214328 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aa86661d-5c4f-49b9-bd9a-f1137066aff2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:56.215510 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aa86661d-5c4f-49b9-bd9a-f1137066aff2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:56.216120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aa86661d-5c4f-49b9-bd9a-f1137066aff2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:56.216549 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aa86661d-5c4f-49b9-bd9a-f1137066aff2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:56.412033 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-aa86661d-5c4f-49b9-bd9a-f1137066aff2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:56.420806 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-aa86661d-5c4f-49b9-bd9a-f1137066aff2 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1688 microversion: 2.1 time: 0.218162 Oct 27 17:37:56.421624 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 390/811] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:56 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1688 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:56.765808 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-bcc90407-1037-4562-b235-491b31f95b0e req-6c94d583-de29-45dc-bd40-6a12d30543ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41584d40-839e-4610-9c2b-7291f0d8d790", "name": "network-vif-deleted", "tag": "9f15684a-2e4a-47e6-b9f4-740131fbedfb"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:37:56.775908 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-bcc90407-1037-4562-b235-491b31f95b0e req-6c94d583-de29-45dc-bd40-6a12d30543ca service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:56.776476 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-bcc90407-1037-4562-b235-491b31f95b0e req-6c94d583-de29-45dc-bd40-6a12d30543ca service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:56.777009 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-bcc90407-1037-4562-b235-491b31f95b0e req-6c94d583-de29-45dc-bd40-6a12d30543ca service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:56.789832 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-bcc90407-1037-4562-b235-491b31f95b0e req-6c94d583-de29-45dc-bd40-6a12d30543ca service nova] Creating event network-vif-deleted:9f15684a-2e4a-47e6-b9f4-740131fbedfb for instance 41584d40-839e-4610-9c2b-7291f0d8d790 on hv-cinder-86283 Oct 27 17:37:56.795631 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-bcc90407-1037-4562-b235-491b31f95b0e req-6c94d583-de29-45dc-bd40-6a12d30543ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034164 Oct 27 17:37:56.799962 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 422/812] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:37:57.001465 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-170a1695-bdb7-425a-80d3-3b73339059db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:57.002129 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-170a1695-bdb7-425a-80d3-3b73339059db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:57.008251 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-170a1695-bdb7-425a-80d3-3b73339059db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:57.008725 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-170a1695-bdb7-425a-80d3-3b73339059db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:57.009317 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-170a1695-bdb7-425a-80d3-3b73339059db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:57.010404 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-170a1695-bdb7-425a-80d3-3b73339059db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:57.010404 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-170a1695-bdb7-425a-80d3-3b73339059db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:57.010919 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-170a1695-bdb7-425a-80d3-3b73339059db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:57.146848 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-170a1695-bdb7-425a-80d3-3b73339059db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:57.155271 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-170a1695-bdb7-425a-80d3-3b73339059db tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.157698 Oct 27 17:37:57.155856 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 391/813] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:56 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:37:57.443667 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-86cc0833-b841-4137-a229-208299ad5969 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:57.444417 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-86cc0833-b841-4137-a229-208299ad5969 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:57.452055 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-86cc0833-b841-4137-a229-208299ad5969 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:57.452578 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-86cc0833-b841-4137-a229-208299ad5969 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:57.453008 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-86cc0833-b841-4137-a229-208299ad5969 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:57.453806 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-86cc0833-b841-4137-a229-208299ad5969 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:57.454258 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-86cc0833-b841-4137-a229-208299ad5969 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:57.454693 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-86cc0833-b841-4137-a229-208299ad5969 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:57.487587 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-86cc0833-b841-4137-a229-208299ad5969 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:57.488111 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-86cc0833-b841-4137-a229-208299ad5969 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:57.488541 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-86cc0833-b841-4137-a229-208299ad5969 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:57.489008 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.objects.instance [None req-86cc0833-b841-4137-a229-208299ad5969 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lazy-loading 'fault' on Instance uuid 41584d40-839e-4610-9c2b-7291f0d8d790 {{(pid=119047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:37:57.531219 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-86cc0833-b841-4137-a229-208299ad5969 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:57.539210 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-86cc0833-b841-4137-a229-208299ad5969 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 200 len: 1335 microversion: 2.1 time: 0.099730 Oct 27 17:37:57.540167 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 423/814] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:57 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 1335 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:58.178662 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4bba4635-ba6d-47de-ad11-554648bbf0d1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:58.179296 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4bba4635-ba6d-47de-ad11-554648bbf0d1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:58.186559 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4bba4635-ba6d-47de-ad11-554648bbf0d1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:58.187041 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4bba4635-ba6d-47de-ad11-554648bbf0d1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:58.187499 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4bba4635-ba6d-47de-ad11-554648bbf0d1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:58.188226 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4bba4635-ba6d-47de-ad11-554648bbf0d1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:58.188674 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4bba4635-ba6d-47de-ad11-554648bbf0d1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:58.189093 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4bba4635-ba6d-47de-ad11-554648bbf0d1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:58.315735 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4bba4635-ba6d-47de-ad11-554648bbf0d1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:58.323393 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4bba4635-ba6d-47de-ad11-554648bbf0d1 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.148636 Oct 27 17:37:58.323992 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 392/815] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:58 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:37:58.561674 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-dbe33ad6-ae49-44da-80e7-5d4c448f869e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:58.562288 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-dbe33ad6-ae49-44da-80e7-5d4c448f869e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 41584d40-839e-4610-9c2b-7291f0d8d790] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:58.568856 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dbe33ad6-ae49-44da-80e7-5d4c448f869e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:58.569337 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dbe33ad6-ae49-44da-80e7-5d4c448f869e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:58.569809 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dbe33ad6-ae49-44da-80e7-5d4c448f869e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:58.570496 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dbe33ad6-ae49-44da-80e7-5d4c448f869e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:58.570949 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dbe33ad6-ae49-44da-80e7-5d4c448f869e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:58.571374 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dbe33ad6-ae49-44da-80e7-5d4c448f869e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:58.584664 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-dbe33ad6-ae49-44da-80e7-5d4c448f869e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] HTTP exception thrown: Instance 41584d40-839e-4610-9c2b-7291f0d8d790 could not be found. Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-dbe33ad6-ae49-44da-80e7-5d4c448f869e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Request method failure captured: Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 HTTP/1.1 Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA6QQ2Xe-RueSZa98b1WeX08eTwljkpEVfpwUa3_6OScj4PL9zKGISZTxFfRUWVHCjOh7d01WrvQG15DDLAs0QSPfgfc14moQRiXavFZxgaAAOcGU4FOVDxLJFAwl_ReXyMnJxpnmS-6FQDky2vh8WzLt57pts-AbYVWOip7qcpMPc Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: e29292a8f0184800a931a0cbd8c72bf8 Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1280306624 Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:37:58.586332 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:37:58.587947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e29292a8f0184800a931a0cbd8c72bf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e29292a8f0184800a931a0cbd8c72bf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e29292a8f0184800a931a0cbd8c72bf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e29292a8f0184800a931a0cbd8c72bf8"}]}] Oct 27 17:37:58.587947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1280306624 Oct 27 17:37:58.587947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: e29292a8f0184800a931a0cbd8c72bf8 Oct 27 17:37:58.587947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1280306624 Oct 27 17:37:58.587947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-ServerRescueNegativeTestJSON-1280306624-project Oct 27 17:37:58.587947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:37:58.587947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:37:58.587947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 8c8a2448e10b4ff39adf43a9581cb794 Oct 27 17:37:58.587947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1280306624-project Oct 27 17:37:58.587947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:37:58.587947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance 41584d40-839e-4610-9c2b-7291f0d8d790 could not be found. Oct 27 17:37:58.587947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': '41584d40-839e-4610-9c2b-7291f0d8d790'} Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41584d40-839e-4610-9c2b-7291f0d8d790 could not be found. Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:37:58.588767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41584d40-839e-4610-9c2b-7291f0d8d790 could not be found. Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41584d40-839e-4610-9c2b-7291f0d8d790 could not be found. Oct 27 17:37:58.590640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:37:58.591828 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-dbe33ad6-ae49-44da-80e7-5d4c448f869e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Returning 404 to user: Instance 41584d40-839e-4610-9c2b-7291f0d8d790 could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:37:58.591828 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-dbe33ad6-ae49-44da-80e7-5d4c448f869e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790" status: 404 len: 111 microversion: 2.1 time: 0.029943 Oct 27 17:37:58.591828 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 424/816] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:58 2022] GET /compute/v2.1/servers/41584d40-839e-4610-9c2b-7291f0d8d790 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:37:58.596836 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f7344c0b-8153-4ad1-98c6-df31a1339d25 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '.version_select at 0x7f0788647f70>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:58.615489 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f7344c0b-8153-4ad1-98c6-df31a1339d25 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746470297" status: 202 len: 0 microversion: 2.1 time: 0.022401 Oct 27 17:37:58.616062 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 393/817] 10.222.0.36 () {58 vars in 1221 bytes} [Thu Oct 27 17:37:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746470297 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:37:59.348146 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f74df0cd-60e8-48f1-ac2f-e2d8c4a773f2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:37:59.348764 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f74df0cd-60e8-48f1-ac2f-e2d8c4a773f2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:37:59.354961 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f74df0cd-60e8-48f1-ac2f-e2d8c4a773f2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:59.356283 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f74df0cd-60e8-48f1-ac2f-e2d8c4a773f2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:59.356903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f74df0cd-60e8-48f1-ac2f-e2d8c4a773f2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:59.357763 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f74df0cd-60e8-48f1-ac2f-e2d8c4a773f2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:37:59.358371 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f74df0cd-60e8-48f1-ac2f-e2d8c4a773f2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:37:59.358948 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f74df0cd-60e8-48f1-ac2f-e2d8c4a773f2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:37:59.509782 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f74df0cd-60e8-48f1-ac2f-e2d8c4a773f2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:37:59.517960 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f74df0cd-60e8-48f1-ac2f-e2d8c4a773f2 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.174193 Oct 27 17:37:59.528501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 425/818] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:37:59 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:00.543150 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-fa152ff6-324d-4e41-baf8-85402fe35b11 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:00.543781 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-fa152ff6-324d-4e41-baf8-85402fe35b11 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:00.550860 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fa152ff6-324d-4e41-baf8-85402fe35b11 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:00.551343 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fa152ff6-324d-4e41-baf8-85402fe35b11 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:00.551909 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fa152ff6-324d-4e41-baf8-85402fe35b11 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:00.552737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fa152ff6-324d-4e41-baf8-85402fe35b11 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:00.553191 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fa152ff6-324d-4e41-baf8-85402fe35b11 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:00.553614 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fa152ff6-324d-4e41-baf8-85402fe35b11 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:00.689874 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-fa152ff6-324d-4e41-baf8-85402fe35b11 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:00.697801 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-fa152ff6-324d-4e41-baf8-85402fe35b11 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.159293 Oct 27 17:38:00.698407 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 394/819] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:00 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:01.710842 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-bf96be30-a0f3-4bf8-bf25-e5c09b39a5f8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:01.711340 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-bf96be30-a0f3-4bf8-bf25-e5c09b39a5f8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:01.718825 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bf96be30-a0f3-4bf8-bf25-e5c09b39a5f8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:01.719302 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bf96be30-a0f3-4bf8-bf25-e5c09b39a5f8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:01.719745 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bf96be30-a0f3-4bf8-bf25-e5c09b39a5f8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:01.720436 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bf96be30-a0f3-4bf8-bf25-e5c09b39a5f8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:01.720888 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bf96be30-a0f3-4bf8-bf25-e5c09b39a5f8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:01.721306 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bf96be30-a0f3-4bf8-bf25-e5c09b39a5f8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:01.722073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-c4d72e1a-f472-4737-8897-51e7e2314cf7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:01.722725 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c4d72e1a-f472-4737-8897-51e7e2314cf7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:01.725814 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:38:01.729476 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c4d72e1a-f472-4737-8897-51e7e2314cf7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:01.729964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c4d72e1a-f472-4737-8897-51e7e2314cf7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:01.730399 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c4d72e1a-f472-4737-8897-51e7e2314cf7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:01.731099 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c4d72e1a-f472-4737-8897-51e7e2314cf7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:01.731570 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c4d72e1a-f472-4737-8897-51e7e2314cf7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:01.732023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c4d72e1a-f472-4737-8897-51e7e2314cf7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:01.749767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-bf96be30-a0f3-4bf8-bf25-e5c09b39a5f8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Going to try to terminate instance {{(pid=119047) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:38:01.829575 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-bf96be30-a0f3-4bf8-bf25-e5c09b39a5f8 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 204 len: 0 microversion: 2.1 time: 0.122186 Oct 27 17:38:01.832734 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 426/820] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:38:01 2022] DELETE /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:38:01.838885 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-61d707d4-9d40-4985-973f-2b8103273bb7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:01.839604 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-61d707d4-9d40-4985-973f-2b8103273bb7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:01.846550 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61d707d4-9d40-4985-973f-2b8103273bb7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:01.847023 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61d707d4-9d40-4985-973f-2b8103273bb7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:01.847462 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61d707d4-9d40-4985-973f-2b8103273bb7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:01.848185 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61d707d4-9d40-4985-973f-2b8103273bb7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:01.848642 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61d707d4-9d40-4985-973f-2b8103273bb7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:01.849065 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61d707d4-9d40-4985-973f-2b8103273bb7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:01.878224 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-c4d72e1a-f472-4737-8897-51e7e2314cf7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:01.886296 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-c4d72e1a-f472-4737-8897-51e7e2314cf7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.168006 Oct 27 17:38:01.887406 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 395/821] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:01 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:38:01.980741 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-61d707d4-9d40-4985-973f-2b8103273bb7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:01.988399 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-61d707d4-9d40-4985-973f-2b8103273bb7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1508 microversion: 2.1 time: 0.154153 Oct 27 17:38:01.988958 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 427/822] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:01 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:02.434542 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-479951f3-c0e9-4429-93a9-90e4b12a9780 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:02.436790 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-479951f3-c0e9-4429-93a9-90e4b12a9780 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:02.442681 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-479951f3-c0e9-4429-93a9-90e4b12a9780 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:02.443164 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-479951f3-c0e9-4429-93a9-90e4b12a9780 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:02.443599 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-479951f3-c0e9-4429-93a9-90e4b12a9780 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:02.444310 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-479951f3-c0e9-4429-93a9-90e4b12a9780 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:02.444765 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-479951f3-c0e9-4429-93a9-90e4b12a9780 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:02.445187 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-479951f3-c0e9-4429-93a9-90e4b12a9780 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:02.476690 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-479951f3-c0e9-4429-93a9-90e4b12a9780 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046663 Oct 27 17:38:02.477245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 396/823] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:38:02 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 17:38:02.540940 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4e360937-8c74-4be7-82ab-2c6fd4d997e3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:02.541435 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4e360937-8c74-4be7-82ab-2c6fd4d997e3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:02.547968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4e360937-8c74-4be7-82ab-2c6fd4d997e3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:02.548446 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4e360937-8c74-4be7-82ab-2c6fd4d997e3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:02.548875 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4e360937-8c74-4be7-82ab-2c6fd4d997e3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:02.549557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4e360937-8c74-4be7-82ab-2c6fd4d997e3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:02.550005 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4e360937-8c74-4be7-82ab-2c6fd4d997e3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:02.550422 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4e360937-8c74-4be7-82ab-2c6fd4d997e3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:02.575281 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4e360937-8c74-4be7-82ab-2c6fd4d997e3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Going to try to terminate instance {{(pid=119047) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:38:02.648052 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4e360937-8c74-4be7-82ab-2c6fd4d997e3 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 204 len: 0 microversion: 2.1 time: 0.110673 Oct 27 17:38:02.648544 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 428/824] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:38:02 2022] DELETE /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:38:02.656759 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-120d94cf-b352-4581-932c-1f9d29ac2e59 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:02.657470 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-120d94cf-b352-4581-932c-1f9d29ac2e59 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:02.663833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-120d94cf-b352-4581-932c-1f9d29ac2e59 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:02.664319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-120d94cf-b352-4581-932c-1f9d29ac2e59 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:02.664738 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-120d94cf-b352-4581-932c-1f9d29ac2e59 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:02.665423 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-120d94cf-b352-4581-932c-1f9d29ac2e59 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:02.665888 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-120d94cf-b352-4581-932c-1f9d29ac2e59 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:02.666306 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-120d94cf-b352-4581-932c-1f9d29ac2e59 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:02.795060 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-120d94cf-b352-4581-932c-1f9d29ac2e59 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:02.802718 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-120d94cf-b352-4581-932c-1f9d29ac2e59 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1672 microversion: 2.1 time: 0.149813 Oct 27 17:38:02.803280 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 397/825] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:02 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:02.911253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-93fdf90a-7393-41b7-87cd-2173dbcd16e7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:02.911930 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-93fdf90a-7393-41b7-87cd-2173dbcd16e7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:02.918888 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93fdf90a-7393-41b7-87cd-2173dbcd16e7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:02.919361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93fdf90a-7393-41b7-87cd-2173dbcd16e7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:02.919817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93fdf90a-7393-41b7-87cd-2173dbcd16e7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:02.920500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93fdf90a-7393-41b7-87cd-2173dbcd16e7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:02.920950 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93fdf90a-7393-41b7-87cd-2173dbcd16e7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:02.921369 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93fdf90a-7393-41b7-87cd-2173dbcd16e7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:03.010251 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-de4d9d0b-d760-4442-99db-953c174bc7b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:03.010865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-de4d9d0b-d760-4442-99db-953c174bc7b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:03.016816 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-de4d9d0b-d760-4442-99db-953c174bc7b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:03.017305 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-de4d9d0b-d760-4442-99db-953c174bc7b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:03.017744 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-de4d9d0b-d760-4442-99db-953c174bc7b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:03.018437 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-de4d9d0b-d760-4442-99db-953c174bc7b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:03.018892 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-de4d9d0b-d760-4442-99db-953c174bc7b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:03.019318 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-de4d9d0b-d760-4442-99db-953c174bc7b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:03.056090 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-93fdf90a-7393-41b7-87cd-2173dbcd16e7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:03.063988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-93fdf90a-7393-41b7-87cd-2173dbcd16e7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.157050 Oct 27 17:38:03.064565 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 429/826] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:02 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:03.145926 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-de4d9d0b-d760-4442-99db-953c174bc7b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:03.154062 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-de4d9d0b-d760-4442-99db-953c174bc7b6 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1508 microversion: 2.1 time: 0.147625 Oct 27 17:38:03.154629 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 398/827] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:03 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:38:03.826599 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1012058e-5eca-4864-9ae5-489165513b2d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:03.827215 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-1012058e-5eca-4864-9ae5-489165513b2d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:03.833350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1012058e-5eca-4864-9ae5-489165513b2d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:03.833770 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1012058e-5eca-4864-9ae5-489165513b2d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:03.834201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1012058e-5eca-4864-9ae5-489165513b2d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:03.834880 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1012058e-5eca-4864-9ae5-489165513b2d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:03.835329 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1012058e-5eca-4864-9ae5-489165513b2d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:03.835768 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1012058e-5eca-4864-9ae5-489165513b2d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:03.962802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1012058e-5eca-4864-9ae5-489165513b2d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:03.971215 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1012058e-5eca-4864-9ae5-489165513b2d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1672 microversion: 2.1 time: 0.148536 Oct 27 17:38:03.971797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 430/828] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:03 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:04.087442 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8ab64046-1f8a-49f3-9880-9f8bbd83a63a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:04.088005 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8ab64046-1f8a-49f3-9880-9f8bbd83a63a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:04.095018 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ab64046-1f8a-49f3-9880-9f8bbd83a63a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:04.095496 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ab64046-1f8a-49f3-9880-9f8bbd83a63a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:04.095962 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ab64046-1f8a-49f3-9880-9f8bbd83a63a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:04.096645 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ab64046-1f8a-49f3-9880-9f8bbd83a63a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:04.097096 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ab64046-1f8a-49f3-9880-9f8bbd83a63a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:04.097516 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ab64046-1f8a-49f3-9880-9f8bbd83a63a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:04.116308 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=100 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:38:04.177501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2229f1b5-9635-4215-8001-dbc8d4c659b4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:04.178158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2229f1b5-9635-4215-8001-dbc8d4c659b4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:04.184140 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2229f1b5-9635-4215-8001-dbc8d4c659b4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:04.184627 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2229f1b5-9635-4215-8001-dbc8d4c659b4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:04.185069 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2229f1b5-9635-4215-8001-dbc8d4c659b4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:04.185771 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2229f1b5-9635-4215-8001-dbc8d4c659b4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:04.186236 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2229f1b5-9635-4215-8001-dbc8d4c659b4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:04.186662 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2229f1b5-9635-4215-8001-dbc8d4c659b4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:04.289134 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8ab64046-1f8a-49f3-9880-9f8bbd83a63a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:04.298065 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8ab64046-1f8a-49f3-9880-9f8bbd83a63a tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.214507 Oct 27 17:38:04.299173 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 399/829] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:04 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:04.636097 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2229f1b5-9635-4215-8001-dbc8d4c659b4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:04.644751 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2229f1b5-9635-4215-8001-dbc8d4c659b4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1508 microversion: 2.1 time: 0.471169 Oct 27 17:38:04.645527 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 431/830] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:04 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1508 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:38:04.964421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-db4fd9f5-d5d6-4943-a5b4-e84888102e10 req-764f7132-9769-4653-a422-ad1b83c51831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c65005a-985e-4fae-a09d-8cfc17bc9e93", "name": "network-vif-deleted", "tag": "ed86609d-1807-41a9-9302-15671bc13ea6"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:38:04.976508 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-db4fd9f5-d5d6-4943-a5b4-e84888102e10 req-764f7132-9769-4653-a422-ad1b83c51831 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:04.977210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-db4fd9f5-d5d6-4943-a5b4-e84888102e10 req-764f7132-9769-4653-a422-ad1b83c51831 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:04.977626 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-db4fd9f5-d5d6-4943-a5b4-e84888102e10 req-764f7132-9769-4653-a422-ad1b83c51831 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:04.989808 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-db4fd9f5-d5d6-4943-a5b4-e84888102e10 req-764f7132-9769-4653-a422-ad1b83c51831 service nova] Creating event network-vif-deleted:ed86609d-1807-41a9-9302-15671bc13ea6 for instance 3c65005a-985e-4fae-a09d-8cfc17bc9e93 on hv-cinder-86283 Oct 27 17:38:04.995280 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-db4fd9f5-d5d6-4943-a5b4-e84888102e10 req-764f7132-9769-4653-a422-ad1b83c51831 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034735 Oct 27 17:38:04.996627 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 400/831] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:38:05.000454 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f38265bd-6a56-45ba-a0e7-cac8e2195c24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:05.001087 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f38265bd-6a56-45ba-a0e7-cac8e2195c24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:05.013715 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f38265bd-6a56-45ba-a0e7-cac8e2195c24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:05.017618 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f38265bd-6a56-45ba-a0e7-cac8e2195c24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:05.018075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f38265bd-6a56-45ba-a0e7-cac8e2195c24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:05.019098 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f38265bd-6a56-45ba-a0e7-cac8e2195c24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:05.019845 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f38265bd-6a56-45ba-a0e7-cac8e2195c24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:05.020277 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f38265bd-6a56-45ba-a0e7-cac8e2195c24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:05.128750 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f38265bd-6a56-45ba-a0e7-cac8e2195c24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:05.137583 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f38265bd-6a56-45ba-a0e7-cac8e2195c24 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1605 microversion: 2.1 time: 0.143691 Oct 27 17:38:05.138403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 432/832] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:04 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1605 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:05.323396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-bb385056-a1d6-4352-9ab5-aaebf2cc7dc3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:05.324863 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-bb385056-a1d6-4352-9ab5-aaebf2cc7dc3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:05.331193 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bb385056-a1d6-4352-9ab5-aaebf2cc7dc3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:05.331682 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bb385056-a1d6-4352-9ab5-aaebf2cc7dc3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:05.332149 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bb385056-a1d6-4352-9ab5-aaebf2cc7dc3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:05.332850 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bb385056-a1d6-4352-9ab5-aaebf2cc7dc3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:05.333303 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bb385056-a1d6-4352-9ab5-aaebf2cc7dc3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:05.333720 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bb385056-a1d6-4352-9ab5-aaebf2cc7dc3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:05.434957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-0261cd94-25a0-465f-8789-4fe95ac6adbb req-d32f1f9f-de9f-44e4-86f1-066eadfc7cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9f11af-ebc7-4b43-80e4-e03e24ae3490", "name": "network-vif-deleted", "tag": "689c3b28-8322-4e68-94df-67c69ac85d72"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:38:05.444347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-0261cd94-25a0-465f-8789-4fe95ac6adbb req-d32f1f9f-de9f-44e4-86f1-066eadfc7cde service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:05.444835 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-0261cd94-25a0-465f-8789-4fe95ac6adbb req-d32f1f9f-de9f-44e4-86f1-066eadfc7cde service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:05.445268 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-0261cd94-25a0-465f-8789-4fe95ac6adbb req-d32f1f9f-de9f-44e4-86f1-066eadfc7cde service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:05.456960 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-0261cd94-25a0-465f-8789-4fe95ac6adbb req-d32f1f9f-de9f-44e4-86f1-066eadfc7cde service nova] Creating event network-vif-deleted:689c3b28-8322-4e68-94df-67c69ac85d72 for instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 on hv-cinder-86283 Oct 27 17:38:05.461820 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-0261cd94-25a0-465f-8789-4fe95ac6adbb req-d32f1f9f-de9f-44e4-86f1-066eadfc7cde service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031095 Oct 27 17:38:05.462595 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 433/833] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:38:05.481207 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-bb385056-a1d6-4352-9ab5-aaebf2cc7dc3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:05.488915 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-bb385056-a1d6-4352-9ab5-aaebf2cc7dc3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.170331 Oct 27 17:38:05.489484 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 401/834] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:05 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:05.666994 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c97ea757-51a3-4dc8-a94b-27a41714e632 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:05.668442 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c97ea757-51a3-4dc8-a94b-27a41714e632 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:05.674697 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c97ea757-51a3-4dc8-a94b-27a41714e632 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:05.675109 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c97ea757-51a3-4dc8-a94b-27a41714e632 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:05.675541 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c97ea757-51a3-4dc8-a94b-27a41714e632 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:05.676251 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c97ea757-51a3-4dc8-a94b-27a41714e632 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:05.676700 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c97ea757-51a3-4dc8-a94b-27a41714e632 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:05.677120 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c97ea757-51a3-4dc8-a94b-27a41714e632 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:05.707830 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c97ea757-51a3-4dc8-a94b-27a41714e632 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:05.708312 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c97ea757-51a3-4dc8-a94b-27a41714e632 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:05.708741 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c97ea757-51a3-4dc8-a94b-27a41714e632 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:05.709181 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.objects.instance [None req-c97ea757-51a3-4dc8-a94b-27a41714e632 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lazy-loading 'fault' on Instance uuid 3c65005a-985e-4fae-a09d-8cfc17bc9e93 {{(pid=119047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:38:05.751083 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c97ea757-51a3-4dc8-a94b-27a41714e632 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:05.758711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c97ea757-51a3-4dc8-a94b-27a41714e632 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1312 microversion: 2.1 time: 0.096003 Oct 27 17:38:05.759352 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 434/835] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:05 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:06.160409 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-62f21287-0e96-4fb0-9e40-6bad56c78ebc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:06.161120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-62f21287-0e96-4fb0-9e40-6bad56c78ebc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:06.167147 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62f21287-0e96-4fb0-9e40-6bad56c78ebc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:06.167634 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62f21287-0e96-4fb0-9e40-6bad56c78ebc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:06.168731 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62f21287-0e96-4fb0-9e40-6bad56c78ebc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:06.169426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62f21287-0e96-4fb0-9e40-6bad56c78ebc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:06.169877 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62f21287-0e96-4fb0-9e40-6bad56c78ebc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:06.170298 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-62f21287-0e96-4fb0-9e40-6bad56c78ebc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:06.233026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-62f21287-0e96-4fb0-9e40-6bad56c78ebc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:06.241062 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-62f21287-0e96-4fb0-9e40-6bad56c78ebc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1605 microversion: 2.1 time: 0.084470 Oct 27 17:38:06.241652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 402/836] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:06 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1605 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:06.513866 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-21826383-fe82-4094-8fb2-f9ab9fb0f471 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:06.514477 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-21826383-fe82-4094-8fb2-f9ab9fb0f471 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:06.520937 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21826383-fe82-4094-8fb2-f9ab9fb0f471 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:06.521422 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21826383-fe82-4094-8fb2-f9ab9fb0f471 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:06.521854 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21826383-fe82-4094-8fb2-f9ab9fb0f471 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:06.522543 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21826383-fe82-4094-8fb2-f9ab9fb0f471 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:06.522994 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21826383-fe82-4094-8fb2-f9ab9fb0f471 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:06.523417 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-21826383-fe82-4094-8fb2-f9ab9fb0f471 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:06.663611 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-21826383-fe82-4094-8fb2-f9ab9fb0f471 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:06.672061 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-21826383-fe82-4094-8fb2-f9ab9fb0f471 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.162662 Oct 27 17:38:06.672622 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 435/837] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:06 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:06.781085 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-98d67676-8474-4682-bef5-57c3d0032e83 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:06.781695 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-98d67676-8474-4682-bef5-57c3d0032e83 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:06.788034 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-98d67676-8474-4682-bef5-57c3d0032e83 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:06.788509 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-98d67676-8474-4682-bef5-57c3d0032e83 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:06.788939 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-98d67676-8474-4682-bef5-57c3d0032e83 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:06.789705 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-98d67676-8474-4682-bef5-57c3d0032e83 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:06.790067 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-98d67676-8474-4682-bef5-57c3d0032e83 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:06.790482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-98d67676-8474-4682-bef5-57c3d0032e83 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:06.821692 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-98d67676-8474-4682-bef5-57c3d0032e83 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:06.822171 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-98d67676-8474-4682-bef5-57c3d0032e83 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:06.822597 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-98d67676-8474-4682-bef5-57c3d0032e83 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:06.823034 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-98d67676-8474-4682-bef5-57c3d0032e83 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lazy-loading 'fault' on Instance uuid 3c65005a-985e-4fae-a09d-8cfc17bc9e93 {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:38:06.863866 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-98d67676-8474-4682-bef5-57c3d0032e83 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:06.871362 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-98d67676-8474-4682-bef5-57c3d0032e83 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 200 len: 1312 microversion: 2.1 time: 0.094593 Oct 27 17:38:06.871978 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 403/838] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:06 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:07.264831 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-18e32160-2683-470d-a09d-d9fdb901f3d8 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:07.265674 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-18e32160-2683-470d-a09d-d9fdb901f3d8 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:07.272417 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18e32160-2683-470d-a09d-d9fdb901f3d8 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:07.273295 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18e32160-2683-470d-a09d-d9fdb901f3d8 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:07.273741 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18e32160-2683-470d-a09d-d9fdb901f3d8 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:07.275184 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18e32160-2683-470d-a09d-d9fdb901f3d8 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:07.275649 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18e32160-2683-470d-a09d-d9fdb901f3d8 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:07.276231 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18e32160-2683-470d-a09d-d9fdb901f3d8 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:07.309818 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18e32160-2683-470d-a09d-d9fdb901f3d8 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:07.310306 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18e32160-2683-470d-a09d-d9fdb901f3d8 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:07.310755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-18e32160-2683-470d-a09d-d9fdb901f3d8 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:07.311201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.objects.instance [None req-18e32160-2683-470d-a09d-d9fdb901f3d8 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lazy-loading 'fault' on Instance uuid 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 {{(pid=119047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:38:07.352920 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-18e32160-2683-470d-a09d-d9fdb901f3d8 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:07.360968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-18e32160-2683-470d-a09d-d9fdb901f3d8 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 200 len: 1327 microversion: 2.1 time: 0.100637 Oct 27 17:38:07.361531 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 436/839] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:07 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:07.694687 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-41cd3432-40b0-4ae6-a018-63197204c6a7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:07.695293 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-41cd3432-40b0-4ae6-a018-63197204c6a7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:07.702241 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-41cd3432-40b0-4ae6-a018-63197204c6a7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:07.702724 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-41cd3432-40b0-4ae6-a018-63197204c6a7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:07.703150 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-41cd3432-40b0-4ae6-a018-63197204c6a7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:07.703879 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-41cd3432-40b0-4ae6-a018-63197204c6a7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:07.704334 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-41cd3432-40b0-4ae6-a018-63197204c6a7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:07.704753 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-41cd3432-40b0-4ae6-a018-63197204c6a7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:07.844325 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-41cd3432-40b0-4ae6-a018-63197204c6a7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:07.852299 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-41cd3432-40b0-4ae6-a018-63197204c6a7 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1571 microversion: 2.1 time: 0.161788 Oct 27 17:38:07.852857 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 404/840] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:07 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:38:07.874639 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-e415e1df-4f02-4977-8afd-734f5d161bfa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:38:07.875241 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e415e1df-4f02-4977-8afd-734f5d161bfa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:07.881855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e415e1df-4f02-4977-8afd-734f5d161bfa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:07.882343 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e415e1df-4f02-4977-8afd-734f5d161bfa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:07.882781 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e415e1df-4f02-4977-8afd-734f5d161bfa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:07.883471 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e415e1df-4f02-4977-8afd-734f5d161bfa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:07.883957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e415e1df-4f02-4977-8afd-734f5d161bfa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:07.884399 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e415e1df-4f02-4977-8afd-734f5d161bfa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:07.893643 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8cd70563-4863-4ea4-8ca1-8bdaf5ca313f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:07.894239 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8cd70563-4863-4ea4-8ca1-8bdaf5ca313f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 3c65005a-985e-4fae-a09d-8cfc17bc9e93] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:07.900242 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cd70563-4863-4ea4-8ca1-8bdaf5ca313f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:07.900719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cd70563-4863-4ea4-8ca1-8bdaf5ca313f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:07.901147 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cd70563-4863-4ea4-8ca1-8bdaf5ca313f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:07.901844 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cd70563-4863-4ea4-8ca1-8bdaf5ca313f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:07.902911 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cd70563-4863-4ea4-8ca1-8bdaf5ca313f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:07.903329 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cd70563-4863-4ea4-8ca1-8bdaf5ca313f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:07.916621 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-8cd70563-4863-4ea4-8ca1-8bdaf5ca313f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] HTTP exception thrown: Instance 3c65005a-985e-4fae-a09d-8cfc17bc9e93 could not be found. Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8cd70563-4863-4ea4-8ca1-8bdaf5ca313f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Request method failure captured: Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 HTTP/1.1 Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA6QQ2Xe-RueSZa98b1WeX08eTwljkpEVfpwUa3_6OScj4PL9zKGISZTxFfRUWVHCjOh7d01WrvQG15DDLAs0QSPfgfc14moQRiXavFZxgaAAOcGU4FOVDxLJFAwl_ReXyMnJxpnmS-6FQDky2vh8WzLt57pts-AbYVWOip7qcpMPc Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: e29292a8f0184800a931a0cbd8c72bf8 Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1280306624 Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:38:07.918493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:38:07.920086 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e29292a8f0184800a931a0cbd8c72bf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e29292a8f0184800a931a0cbd8c72bf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e29292a8f0184800a931a0cbd8c72bf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e29292a8f0184800a931a0cbd8c72bf8"}]}] Oct 27 17:38:07.920086 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1280306624 Oct 27 17:38:07.920086 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: e29292a8f0184800a931a0cbd8c72bf8 Oct 27 17:38:07.920086 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1280306624 Oct 27 17:38:07.920086 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-ServerRescueNegativeTestJSON-1280306624-project Oct 27 17:38:07.920086 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:38:07.920086 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:38:07.920086 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 8c8a2448e10b4ff39adf43a9581cb794 Oct 27 17:38:07.920086 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1280306624-project Oct 27 17:38:07.920086 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:38:07.920086 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance 3c65005a-985e-4fae-a09d-8cfc17bc9e93 could not be found. Oct 27 17:38:07.920086 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '3c65005a-985e-4fae-a09d-8cfc17bc9e93'} Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c65005a-985e-4fae-a09d-8cfc17bc9e93 could not be found. Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:38:07.920887 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c65005a-985e-4fae-a09d-8cfc17bc9e93 could not be found. Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c65005a-985e-4fae-a09d-8cfc17bc9e93 could not be found. Oct 27 17:38:07.922071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:38:07.923197 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8cd70563-4863-4ea4-8ca1-8bdaf5ca313f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Returning 404 to user: Instance 3c65005a-985e-4fae-a09d-8cfc17bc9e93 could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:38:07.923197 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8cd70563-4863-4ea4-8ca1-8bdaf5ca313f tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93" status: 404 len: 111 microversion: 2.1 time: 0.029954 Oct 27 17:38:07.923197 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 405/841] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:07 2022] GET /compute/v2.1/servers/3c65005a-985e-4fae-a09d-8cfc17bc9e93 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 17:38:07.927805 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-126a38e4-c69f-45dd-bd94-0c0013a9862d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:07.928289 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-126a38e4-c69f-45dd-bd94-0c0013a9862d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:07.930077 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e415e1df-4f02-4977-8afd-734f5d161bfa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119047) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 17:38:07.933909 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-126a38e4-c69f-45dd-bd94-0c0013a9862d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:07.934378 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-126a38e4-c69f-45dd-bd94-0c0013a9862d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:07.934807 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-126a38e4-c69f-45dd-bd94-0c0013a9862d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:07.935482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-126a38e4-c69f-45dd-bd94-0c0013a9862d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:07.935953 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-126a38e4-c69f-45dd-bd94-0c0013a9862d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:07.936371 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-126a38e4-c69f-45dd-bd94-0c0013a9862d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:07.962063 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-126a38e4-c69f-45dd-bd94-0c0013a9862d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Going to try to terminate instance {{(pid=119046) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:38:08.000036 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-e415e1df-4f02-4977-8afd-734f5d161bfa tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "POST /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd/action" status: 202 len: 0 microversion: 2.1 time: 0.129268 Oct 27 17:38:08.000900 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 437/842] 10.222.0.36 () {60 vars in 1278 bytes} [Thu Oct 27 17:38:07 2022] POST /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:38:08.008827 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-93887d3a-cb5f-44c4-b419-942d2acd97fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:08.009781 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-93887d3a-cb5f-44c4-b419-942d2acd97fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:08.018196 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93887d3a-cb5f-44c4-b419-942d2acd97fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:08.018667 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93887d3a-cb5f-44c4-b419-942d2acd97fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:08.019151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93887d3a-cb5f-44c4-b419-942d2acd97fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:08.020044 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93887d3a-cb5f-44c4-b419-942d2acd97fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:08.020501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93887d3a-cb5f-44c4-b419-942d2acd97fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:08.020933 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-93887d3a-cb5f-44c4-b419-942d2acd97fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:08.040692 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:38:08.056059 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-126a38e4-c69f-45dd-bd94-0c0013a9862d tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 204 len: 0 microversion: 2.1 time: 0.131443 Oct 27 17:38:08.056817 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 406/843] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:38:07 2022] DELETE /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 17:38:08.065843 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f8c1e199-014d-45ee-b0b9-953a9ca34487 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:08.066619 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-f8c1e199-014d-45ee-b0b9-953a9ca34487 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:08.073627 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8c1e199-014d-45ee-b0b9-953a9ca34487 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:08.074854 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8c1e199-014d-45ee-b0b9-953a9ca34487 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:08.075367 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8c1e199-014d-45ee-b0b9-953a9ca34487 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:08.076160 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8c1e199-014d-45ee-b0b9-953a9ca34487 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:08.076726 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8c1e199-014d-45ee-b0b9-953a9ca34487 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:08.077210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f8c1e199-014d-45ee-b0b9-953a9ca34487 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:08.165977 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-93887d3a-cb5f-44c4-b419-942d2acd97fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:08.174433 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-93887d3a-cb5f-44c4-b419-942d2acd97fe tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1579 microversion: 2.1 time: 0.169253 Oct 27 17:38:08.175224 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 438/844] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:08 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1579 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:38:08.228594 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f8c1e199-014d-45ee-b0b9-953a9ca34487 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:08.236803 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f8c1e199-014d-45ee-b0b9-953a9ca34487 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.175028 Oct 27 17:38:08.237381 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 407/845] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:08 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:08.383639 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ca65c7b2-f59d-4932-86f8-cba11d440a04 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:08.384291 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-ca65c7b2-f59d-4932-86f8-cba11d440a04 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:08.390935 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ca65c7b2-f59d-4932-86f8-cba11d440a04 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:08.391493 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ca65c7b2-f59d-4932-86f8-cba11d440a04 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:08.392135 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ca65c7b2-f59d-4932-86f8-cba11d440a04 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:08.392828 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ca65c7b2-f59d-4932-86f8-cba11d440a04 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:08.393279 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ca65c7b2-f59d-4932-86f8-cba11d440a04 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:08.393702 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ca65c7b2-f59d-4932-86f8-cba11d440a04 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:08.407508 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-ca65c7b2-f59d-4932-86f8-cba11d440a04 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] HTTP exception thrown: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ca65c7b2-f59d-4932-86f8-cba11d440a04 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Request method failure captured: Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 HTTP/1.1 Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA3ZeoAVm4eLP-HT8wF-JAK3j7TWGmYaQUyHeJx6WZ-nCVnkDgPNaZI6E4C8zAhU1rP51uuW-RLu-Knm-skdA2o7AY36fKS4ONXB6ICUSQHfx5tiuVx2YC4nc-oStEFRyVufnMQhWDmfHZ4uIIk_P6eVg6lKCn4lwNgHgKlreRoZvo Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: a9d4d4a323694c4c9244df4f17342a35 Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:38:08.409250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:38:08.410862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9d4d4a323694c4c9244df4f17342a35"}]}] Oct 27 17:38:08.410862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:38:08.410862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: a9d4d4a323694c4c9244df4f17342a35 Oct 27 17:38:08.410862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:38:08.410862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-AttachVolumeTestJSON-389329975-project Oct 27 17:38:08.410862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:38:08.410862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:38:08.410862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 5477ed4bd13542e48263f08761a7ff03 Oct 27 17:38:08.410862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-AttachVolumeTestJSON-389329975-project Oct 27 17:38:08.410862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:38:08.410862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. Oct 27 17:38:08.410862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': '8a9f11af-ebc7-4b43-80e4-e03e24ae3490'} Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:38:08.415347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. Oct 27 17:38:08.416890 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:38:08.418841 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ca65c7b2-f59d-4932-86f8-cba11d440a04 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Returning 404 to user: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:38:08.418841 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-ca65c7b2-f59d-4932-86f8-cba11d440a04 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 404 len: 111 microversion: 2.1 time: 0.031011 Oct 27 17:38:08.418841 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 439/846] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:08 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:38:08.420272 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-33791b40-313c-4c37-be41-38060828fffa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '.version_select at 0x7f0788510ee0>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:08.439328 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-33791b40-313c-4c37-be41-38060828fffa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378676002" status: 202 len: 0 microversion: 2.1 time: 0.023551 Oct 27 17:38:08.440046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 408/847] 10.222.0.36 () {58 vars in 1221 bytes} [Thu Oct 27 17:38:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378676002 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:38:09.128804 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-729e5439-1e8f-4109-981d-6ae04fe2d2ac tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Action: 'create', calling method: .version_select at 0x7f078bf379d0>, body: {"keypair": {"name": "tempest-keypair-1468830997", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFF84rrk5K8tX9TB7D0KnFyRkSrRCrywRTHboD2rOwUek4JIK4yPy7i2YP2OU5kaj948/i6z0XyQ1JQQsvg/JMNqZ50x64GY8vLm0PUAXaZxt+mx3N1mt6R9D4SAJmmOg=="}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:38:09.145188 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-729e5439-1e8f-4109-981d-6ae04fe2d2ac tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Getting quotas for project a9d4d4a323694c4c9244df4f17342a35. Resources: {'key_pairs'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:38:09.149006 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-729e5439-1e8f-4109-981d-6ae04fe2d2ac tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Getting quotas for user 5477ed4bd13542e48263f08761a7ff03 and project a9d4d4a323694c4c9244df4f17342a35. Resources: {'key_pairs'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:38:09.170561 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-729e5439-1e8f-4109-981d-6ae04fe2d2ac tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045656 Oct 27 17:38:09.171133 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 440/848] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Oct 27 17:38:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:38:09.198747 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-fcc21626-6d1c-4699-ba38-3544390d88e3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:09.199362 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-fcc21626-6d1c-4699-ba38-3544390d88e3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:09.206851 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fcc21626-6d1c-4699-ba38-3544390d88e3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:09.207331 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fcc21626-6d1c-4699-ba38-3544390d88e3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:09.207783 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fcc21626-6d1c-4699-ba38-3544390d88e3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:09.208470 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fcc21626-6d1c-4699-ba38-3544390d88e3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:09.208912 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fcc21626-6d1c-4699-ba38-3544390d88e3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:09.209327 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fcc21626-6d1c-4699-ba38-3544390d88e3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:09.260070 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ea2f33e1-cb08-4b30-a696-32a12d5b5fd7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:09.260624 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-ea2f33e1-cb08-4b30-a696-32a12d5b5fd7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:09.267794 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ea2f33e1-cb08-4b30-a696-32a12d5b5fd7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:09.268479 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ea2f33e1-cb08-4b30-a696-32a12d5b5fd7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:09.268915 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ea2f33e1-cb08-4b30-a696-32a12d5b5fd7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:09.269613 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ea2f33e1-cb08-4b30-a696-32a12d5b5fd7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:09.270069 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ea2f33e1-cb08-4b30-a696-32a12d5b5fd7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:09.270495 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ea2f33e1-cb08-4b30-a696-32a12d5b5fd7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:09.408466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-fcc21626-6d1c-4699-ba38-3544390d88e3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:09.416227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ea2f33e1-cb08-4b30-a696-32a12d5b5fd7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:09.417686 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-fcc21626-6d1c-4699-ba38-3544390d88e3 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1519 microversion: 2.1 time: 0.222867 Oct 27 17:38:09.418692 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 409/849] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:09 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1519 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:09.426193 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-ea2f33e1-cb08-4b30-a696-32a12d5b5fd7 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.170069 Oct 27 17:38:09.426885 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 441/850] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:09 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:38:09.709818 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-e0d63905-6f26-4c57-bbcb-f8534994d514 req-be853c28-4149-4b78-8b40-6368ef3dba7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a883d9-7208-49ab-9775-557bba9f7efd", "name": "network-vif-unplugged", "status": "completed", "tag": "469bd0cf-71f5-4704-9199-a07d128929ab"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:38:09.720268 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-e0d63905-6f26-4c57-bbcb-f8534994d514 req-be853c28-4149-4b78-8b40-6368ef3dba7e service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:09.720851 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-e0d63905-6f26-4c57-bbcb-f8534994d514 req-be853c28-4149-4b78-8b40-6368ef3dba7e service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:09.721272 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-e0d63905-6f26-4c57-bbcb-f8534994d514 req-be853c28-4149-4b78-8b40-6368ef3dba7e service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:09.734516 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.compute.server_external_events [req-e0d63905-6f26-4c57-bbcb-f8534994d514 req-be853c28-4149-4b78-8b40-6368ef3dba7e service nova] Unable to find a host for instance 26a883d9-7208-49ab-9775-557bba9f7efd. Dropping event network-vif-unplugged {{(pid=119046) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 17:38:09.735500 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-e0d63905-6f26-4c57-bbcb-f8534994d514 req-be853c28-4149-4b78-8b40-6368ef3dba7e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029779 Oct 27 17:38:09.736244 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 410/851] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 27 17:38:10.442103 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0b5b7149-7b9e-44d8-b832-7f3dc5802d54 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:10.442781 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-0b5b7149-7b9e-44d8-b832-7f3dc5802d54 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:10.449201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0b5b7149-7b9e-44d8-b832-7f3dc5802d54 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:10.449465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0b5b7149-7b9e-44d8-b832-7f3dc5802d54 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:10.449905 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0b5b7149-7b9e-44d8-b832-7f3dc5802d54 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:10.450603 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0b5b7149-7b9e-44d8-b832-7f3dc5802d54 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:10.451105 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0b5b7149-7b9e-44d8-b832-7f3dc5802d54 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:10.451532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0b5b7149-7b9e-44d8-b832-7f3dc5802d54 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:10.454386 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f75756aa-3871-45b7-bb29-9b1dd54e3bd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:10.454996 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-f75756aa-3871-45b7-bb29-9b1dd54e3bd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:10.461575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f75756aa-3871-45b7-bb29-9b1dd54e3bd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:10.461986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f75756aa-3871-45b7-bb29-9b1dd54e3bd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:10.462411 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f75756aa-3871-45b7-bb29-9b1dd54e3bd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:10.463095 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f75756aa-3871-45b7-bb29-9b1dd54e3bd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:10.463538 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f75756aa-3871-45b7-bb29-9b1dd54e3bd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:10.463974 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f75756aa-3871-45b7-bb29-9b1dd54e3bd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:10.609912 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-0b5b7149-7b9e-44d8-b832-7f3dc5802d54 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:10.610725 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f75756aa-3871-45b7-bb29-9b1dd54e3bd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:10.617855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0b5b7149-7b9e-44d8-b832-7f3dc5802d54 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1521 microversion: 2.1 time: 0.179471 Oct 27 17:38:10.618432 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 442/852] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:10 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:10.620481 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f75756aa-3871-45b7-bb29-9b1dd54e3bd4 tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1522 microversion: 2.1 time: 0.169883 Oct 27 17:38:10.621212 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 411/853] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:10 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:10.635866 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-994472413", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ace0e445-53a9-4562-8c1c-1746268e4744"}], "security_groups": [{"name": "tempest-securitygroup--1233176439"}], "key_name": "tempest-keypair-1468830997", "user_data": "}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:38:10.645057 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:38:10.808532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.network.neutron [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] validate_networks() for [('ace0e445-53a9-4562-8c1c-1746268e4744', None, None, None, None, None)] {{(pid=119047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:38:11.348501 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-ced4a8ca-c36d-41a4-be67-8f87bcb3061d req-712a09ba-a83d-476c-8341-369a20927edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7238287c-af11-4c20-96cf-8ee9e4b34e8a", "name": "network-vif-deleted", "tag": "a9b83ac3-e8af-444b-9748-299c30d1dd1d"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:38:11.360221 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-ced4a8ca-c36d-41a4-be67-8f87bcb3061d req-712a09ba-a83d-476c-8341-369a20927edd service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:11.361212 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-ced4a8ca-c36d-41a4-be67-8f87bcb3061d req-712a09ba-a83d-476c-8341-369a20927edd service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:11.361844 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-ced4a8ca-c36d-41a4-be67-8f87bcb3061d req-712a09ba-a83d-476c-8341-369a20927edd service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:11.377263 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-ced4a8ca-c36d-41a4-be67-8f87bcb3061d req-712a09ba-a83d-476c-8341-369a20927edd service nova] Creating event network-vif-deleted:a9b83ac3-e8af-444b-9748-299c30d1dd1d for instance 7238287c-af11-4c20-96cf-8ee9e4b34e8a on hv-cinder-86283 Oct 27 17:38:11.383892 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-ced4a8ca-c36d-41a4-be67-8f87bcb3061d req-712a09ba-a83d-476c-8341-369a20927edd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039521 Oct 27 17:38:11.385961 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 412/854] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:38:11.426739 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Flavor limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:38:11.427193 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Image limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:38:11.427665 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Flavor pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:38:11.428133 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Image pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:38:11.428543 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:38:11.437875 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:11.438356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:11.439000 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:11.439749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:11.440206 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:11.440807 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:11.458459 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Getting quotas for project a9d4d4a323694c4c9244df4f17342a35. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:38:11.462363 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Getting quotas for user 5477ed4bd13542e48263f08761a7ff03 and project a9d4d4a323694c4c9244df4f17342a35. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:38:11.473450 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Going to run 1 instances... {{(pid=119047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:38:11.476048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:38:11.526452 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-aea91901-d1a5-4ebb-95e5-ec76b179ef5d tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.906778 Oct 27 17:38:11.527143 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 443/855] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:38:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:38:11.539282 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2e9c5a29-97c9-4170-80ee-692e983fecdd tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:11.539948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2e9c5a29-97c9-4170-80ee-692e983fecdd tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:11.643151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5cd2a635-556d-400e-a015-67b873601d55 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:11.643972 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-5cd2a635-556d-400e-a015-67b873601d55 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:11.654036 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5cd2a635-556d-400e-a015-67b873601d55 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:11.654608 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5cd2a635-556d-400e-a015-67b873601d55 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:11.656129 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5cd2a635-556d-400e-a015-67b873601d55 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:11.656914 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5cd2a635-556d-400e-a015-67b873601d55 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:11.657600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5cd2a635-556d-400e-a015-67b873601d55 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:11.660468 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2e9c5a29-97c9-4170-80ee-692e983fecdd tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:11.660988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5cd2a635-556d-400e-a015-67b873601d55 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:11.684239 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2e9c5a29-97c9-4170-80ee-692e983fecdd tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 200 len: 1237 microversion: 2.1 time: 0.149418 Oct 27 17:38:11.688872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 413/856] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:11 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 1237 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:11.699410 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-84f895ab-91db-40ff-8883-1a59edce226c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:11.705944 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-84f895ab-91db-40ff-8883-1a59edce226c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:11.715972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-84f895ab-91db-40ff-8883-1a59edce226c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:11.716472 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-84f895ab-91db-40ff-8883-1a59edce226c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:11.716904 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-84f895ab-91db-40ff-8883-1a59edce226c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:11.717711 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-84f895ab-91db-40ff-8883-1a59edce226c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:11.719180 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-84f895ab-91db-40ff-8883-1a59edce226c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:11.719811 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-84f895ab-91db-40ff-8883-1a59edce226c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:11.784366 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-84f895ab-91db-40ff-8883-1a59edce226c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:11.788757 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-84f895ab-91db-40ff-8883-1a59edce226c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:11.789484 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-84f895ab-91db-40ff-8883-1a59edce226c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:11.790031 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-84f895ab-91db-40ff-8883-1a59edce226c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lazy-loading 'fault' on Instance uuid 7238287c-af11-4c20-96cf-8ee9e4b34e8a {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:38:11.843239 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-84f895ab-91db-40ff-8883-1a59edce226c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8a2448e10b4ff39adf43a9581cb794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29292a8f0184800a931a0cbd8c72bf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:11.854671 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-84f895ab-91db-40ff-8883-1a59edce226c tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 200 len: 1312 microversion: 2.1 time: 0.164427 Oct 27 17:38:11.858235 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 414/857] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:11 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:11.896149 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-5cd2a635-556d-400e-a015-67b873601d55 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:11.904711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5cd2a635-556d-400e-a015-67b873601d55 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1577 microversion: 2.1 time: 0.266658 Oct 27 17:38:11.905308 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 444/858] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:11 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1577 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:38:12.712712 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-c0a2f5eb-c591-4177-8123-eb45c5fbdc9e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:12.713318 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c0a2f5eb-c591-4177-8123-eb45c5fbdc9e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:12.719749 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c0a2f5eb-c591-4177-8123-eb45c5fbdc9e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:12.720239 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c0a2f5eb-c591-4177-8123-eb45c5fbdc9e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:12.720671 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c0a2f5eb-c591-4177-8123-eb45c5fbdc9e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:12.721350 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c0a2f5eb-c591-4177-8123-eb45c5fbdc9e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:12.721799 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c0a2f5eb-c591-4177-8123-eb45c5fbdc9e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:12.722219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c0a2f5eb-c591-4177-8123-eb45c5fbdc9e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:12.782146 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-c0a2f5eb-c591-4177-8123-eb45c5fbdc9e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:12.789661 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-c0a2f5eb-c591-4177-8123-eb45c5fbdc9e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 200 len: 1289 microversion: 2.1 time: 0.080766 Oct 27 17:38:12.790253 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 415/859] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:12 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 1289 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:12.881784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d3154348-af40-48fd-bdc8-5fc1b6f8ba3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:12.882391 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d3154348-af40-48fd-bdc8-5fc1b6f8ba3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] [instance: 7238287c-af11-4c20-96cf-8ee9e4b34e8a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:12.889484 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d3154348-af40-48fd-bdc8-5fc1b6f8ba3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:12.889964 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d3154348-af40-48fd-bdc8-5fc1b6f8ba3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:12.890392 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d3154348-af40-48fd-bdc8-5fc1b6f8ba3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:12.891076 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d3154348-af40-48fd-bdc8-5fc1b6f8ba3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:12.891526 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d3154348-af40-48fd-bdc8-5fc1b6f8ba3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:12.891971 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d3154348-af40-48fd-bdc8-5fc1b6f8ba3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:12.905651 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-d3154348-af40-48fd-bdc8-5fc1b6f8ba3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] HTTP exception thrown: Instance 7238287c-af11-4c20-96cf-8ee9e4b34e8a could not be found. Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d3154348-af40-48fd-bdc8-5fc1b6f8ba3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Request method failure captured: Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a HTTP/1.1 Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA6QQ2Xe-RueSZa98b1WeX08eTwljkpEVfpwUa3_6OScj4PL9zKGISZTxFfRUWVHCjOh7d01WrvQG15DDLAs0QSPfgfc14moQRiXavFZxgaAAOcGU4FOVDxLJFAwl_ReXyMnJxpnmS-6FQDky2vh8WzLt57pts-AbYVWOip7qcpMPc Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: e29292a8f0184800a931a0cbd8c72bf8 Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1280306624 Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:38:12.906528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:38:12.908315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e29292a8f0184800a931a0cbd8c72bf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e29292a8f0184800a931a0cbd8c72bf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e29292a8f0184800a931a0cbd8c72bf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e29292a8f0184800a931a0cbd8c72bf8"}]}] Oct 27 17:38:12.908315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1280306624 Oct 27 17:38:12.908315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: e29292a8f0184800a931a0cbd8c72bf8 Oct 27 17:38:12.908315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1280306624 Oct 27 17:38:12.908315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-ServerRescueNegativeTestJSON-1280306624-project Oct 27 17:38:12.908315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:38:12.908315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:38:12.908315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 8c8a2448e10b4ff39adf43a9581cb794 Oct 27 17:38:12.908315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1280306624-project Oct 27 17:38:12.908315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:38:12.908315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance 7238287c-af11-4c20-96cf-8ee9e4b34e8a could not be found. Oct 27 17:38:12.908315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': '7238287c-af11-4c20-96cf-8ee9e4b34e8a'} Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7238287c-af11-4c20-96cf-8ee9e4b34e8a could not be found. Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:38:12.909350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7238287c-af11-4c20-96cf-8ee9e4b34e8a could not be found. Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7238287c-af11-4c20-96cf-8ee9e4b34e8a could not be found. Oct 27 17:38:12.910978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:38:12.912375 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d3154348-af40-48fd-bdc8-5fc1b6f8ba3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] Returning 404 to user: Instance 7238287c-af11-4c20-96cf-8ee9e4b34e8a could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:38:12.912375 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d3154348-af40-48fd-bdc8-5fc1b6f8ba3e tempest-ServerRescueNegativeTestJSON-1280306624 tempest-ServerRescueNegativeTestJSON-1280306624-project] 10.222.0.36 "GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a" status: 404 len: 111 microversion: 2.1 time: 0.029970 Oct 27 17:38:12.912375 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 445/860] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:12 2022] GET /compute/v2.1/servers/7238287c-af11-4c20-96cf-8ee9e4b34e8a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:38:12.929214 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-83cb2eac-fe7c-4f57-b193-664b8ccdae06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:12.929856 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-83cb2eac-fe7c-4f57-b193-664b8ccdae06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:12.936364 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83cb2eac-fe7c-4f57-b193-664b8ccdae06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:12.936895 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83cb2eac-fe7c-4f57-b193-664b8ccdae06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:12.937239 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83cb2eac-fe7c-4f57-b193-664b8ccdae06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:12.937910 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83cb2eac-fe7c-4f57-b193-664b8ccdae06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:12.938350 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83cb2eac-fe7c-4f57-b193-664b8ccdae06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:12.938759 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83cb2eac-fe7c-4f57-b193-664b8ccdae06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:13.075329 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-83cb2eac-fe7c-4f57-b193-664b8ccdae06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:13.083220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-83cb2eac-fe7c-4f57-b193-664b8ccdae06 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1577 microversion: 2.1 time: 0.157754 Oct 27 17:38:13.083901 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 416/861] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:12 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:13.812645 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-7c736e8b-d059-41c0-b552-dc8e5ef64264 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:13.813249 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-7c736e8b-d059-41c0-b552-dc8e5ef64264 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:13.819593 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7c736e8b-d059-41c0-b552-dc8e5ef64264 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:13.820356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7c736e8b-d059-41c0-b552-dc8e5ef64264 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:13.821542 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7c736e8b-d059-41c0-b552-dc8e5ef64264 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:13.822409 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7c736e8b-d059-41c0-b552-dc8e5ef64264 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:13.822865 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7c736e8b-d059-41c0-b552-dc8e5ef64264 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:13.823287 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7c736e8b-d059-41c0-b552-dc8e5ef64264 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:13.891758 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7c736e8b-d059-41c0-b552-dc8e5ef64264 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:13.899149 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-7c736e8b-d059-41c0-b552-dc8e5ef64264 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 200 len: 1289 microversion: 2.1 time: 0.090426 Oct 27 17:38:13.899732 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 446/862] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:13 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:14.106911 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-09dd1992-2009-426c-990c-e3ab9f5de32c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:14.107523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-09dd1992-2009-426c-990c-e3ab9f5de32c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:14.121614 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-09dd1992-2009-426c-990c-e3ab9f5de32c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:14.122103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-09dd1992-2009-426c-990c-e3ab9f5de32c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:14.122527 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-09dd1992-2009-426c-990c-e3ab9f5de32c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:14.123223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-09dd1992-2009-426c-990c-e3ab9f5de32c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:14.123674 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-09dd1992-2009-426c-990c-e3ab9f5de32c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:14.124116 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-09dd1992-2009-426c-990c-e3ab9f5de32c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:14.313547 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-09dd1992-2009-426c-990c-e3ab9f5de32c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:14.321708 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-09dd1992-2009-426c-990c-e3ab9f5de32c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1577 microversion: 2.1 time: 0.218540 Oct 27 17:38:14.337240 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 417/863] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:14 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1577 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:14.923362 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8f6268b6-bcff-4822-a7d8-f44f5d971792 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:14.924291 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8f6268b6-bcff-4822-a7d8-f44f5d971792 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:14.936002 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8f6268b6-bcff-4822-a7d8-f44f5d971792 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:14.936895 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8f6268b6-bcff-4822-a7d8-f44f5d971792 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:14.937504 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8f6268b6-bcff-4822-a7d8-f44f5d971792 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:14.938458 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8f6268b6-bcff-4822-a7d8-f44f5d971792 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:14.939174 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8f6268b6-bcff-4822-a7d8-f44f5d971792 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:14.942664 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8f6268b6-bcff-4822-a7d8-f44f5d971792 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:15.205979 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8f6268b6-bcff-4822-a7d8-f44f5d971792 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:15.220391 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8f6268b6-bcff-4822-a7d8-f44f5d971792 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 200 len: 1363 microversion: 2.1 time: 0.300975 Oct 27 17:38:15.250871 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 447/864] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:14 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:15.352831 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-78cfad33-740c-4e12-9e7a-0db1b4113f0d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:15.353557 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-78cfad33-740c-4e12-9e7a-0db1b4113f0d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:15.366099 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-78cfad33-740c-4e12-9e7a-0db1b4113f0d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:15.369464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-78cfad33-740c-4e12-9e7a-0db1b4113f0d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:15.374232 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-78cfad33-740c-4e12-9e7a-0db1b4113f0d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:15.375218 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-78cfad33-740c-4e12-9e7a-0db1b4113f0d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:15.376546 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-78cfad33-740c-4e12-9e7a-0db1b4113f0d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:15.378829 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-78cfad33-740c-4e12-9e7a-0db1b4113f0d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:15.431190 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:38:15.656342 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-78cfad33-740c-4e12-9e7a-0db1b4113f0d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:15.664827 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-78cfad33-740c-4e12-9e7a-0db1b4113f0d tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1577 microversion: 2.1 time: 0.319991 Oct 27 17:38:15.665444 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 418/865] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:15 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1577 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:15.902684 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-9b26c77e-0088-411d-9100-d48b23a7cb1a req-cb2e5b68-0889-4091-97a7-cb2e69441962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93b27159-1b55-4d07-95ab-6b31d9376fcc", "tag": "fafb856a-ed24-421f-b6a8-a3cb9bd61b71"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:38:15.914119 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-9b26c77e-0088-411d-9100-d48b23a7cb1a req-cb2e5b68-0889-4091-97a7-cb2e69441962 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:15.914883 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-9b26c77e-0088-411d-9100-d48b23a7cb1a req-cb2e5b68-0889-4091-97a7-cb2e69441962 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:15.915317 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-9b26c77e-0088-411d-9100-d48b23a7cb1a req-cb2e5b68-0889-4091-97a7-cb2e69441962 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:15.933201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-9b26c77e-0088-411d-9100-d48b23a7cb1a req-cb2e5b68-0889-4091-97a7-cb2e69441962 service nova] Creating event network-changed:fafb856a-ed24-421f-b6a8-a3cb9bd61b71 for instance 93b27159-1b55-4d07-95ab-6b31d9376fcc on hv-cinder-86283 Oct 27 17:38:15.942180 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-9b26c77e-0088-411d-9100-d48b23a7cb1a req-cb2e5b68-0889-4091-97a7-cb2e69441962 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053196 Oct 27 17:38:15.943470 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 448/866] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:38:16.248939 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-021a1173-04f8-4f05-b45d-e703778aa4b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:16.249883 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-021a1173-04f8-4f05-b45d-e703778aa4b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:16.257061 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-021a1173-04f8-4f05-b45d-e703778aa4b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:16.258598 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-021a1173-04f8-4f05-b45d-e703778aa4b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:16.259391 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-021a1173-04f8-4f05-b45d-e703778aa4b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:16.261131 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-021a1173-04f8-4f05-b45d-e703778aa4b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:16.262093 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-021a1173-04f8-4f05-b45d-e703778aa4b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:16.262955 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-021a1173-04f8-4f05-b45d-e703778aa4b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:16.665421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-021a1173-04f8-4f05-b45d-e703778aa4b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:16.673863 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-021a1173-04f8-4f05-b45d-e703778aa4b4 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 200 len: 1363 microversion: 2.1 time: 0.429554 Oct 27 17:38:16.695412 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-770b900c-9ceb-4a22-9abc-6c11ed119df5 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:16.696051 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-770b900c-9ceb-4a22-9abc-6c11ed119df5 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:16.699405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 419/867] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:16 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 1363 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:16.703188 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-770b900c-9ceb-4a22-9abc-6c11ed119df5 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:16.703858 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-770b900c-9ceb-4a22-9abc-6c11ed119df5 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:16.704550 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-770b900c-9ceb-4a22-9abc-6c11ed119df5 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:16.705498 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-770b900c-9ceb-4a22-9abc-6c11ed119df5 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:16.706057 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-770b900c-9ceb-4a22-9abc-6c11ed119df5 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:16.706973 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-770b900c-9ceb-4a22-9abc-6c11ed119df5 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:16.867981 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-770b900c-9ceb-4a22-9abc-6c11ed119df5 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:16.876327 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-770b900c-9ceb-4a22-9abc-6c11ed119df5 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1577 microversion: 2.1 time: 0.186999 Oct 27 17:38:16.877048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 449/868] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:16 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:17.700428 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b3ab0773-2ae1-4043-992d-a2dcb7061410 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:17.701140 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b3ab0773-2ae1-4043-992d-a2dcb7061410 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:17.708272 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3ab0773-2ae1-4043-992d-a2dcb7061410 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:17.708758 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3ab0773-2ae1-4043-992d-a2dcb7061410 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:17.709189 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3ab0773-2ae1-4043-992d-a2dcb7061410 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:17.710052 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3ab0773-2ae1-4043-992d-a2dcb7061410 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:17.710677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3ab0773-2ae1-4043-992d-a2dcb7061410 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:17.711100 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3ab0773-2ae1-4043-992d-a2dcb7061410 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:17.844134 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b3ab0773-2ae1-4043-992d-a2dcb7061410 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:17.852325 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b3ab0773-2ae1-4043-992d-a2dcb7061410 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 200 len: 1363 microversion: 2.1 time: 0.155858 Oct 27 17:38:17.852991 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 420/869] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:17 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:17.903408 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-7db16ecd-f53e-47e6-a991-c13102559a27 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:17.904114 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-7db16ecd-f53e-47e6-a991-c13102559a27 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:17.910668 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7db16ecd-f53e-47e6-a991-c13102559a27 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:17.911182 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7db16ecd-f53e-47e6-a991-c13102559a27 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:17.911618 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7db16ecd-f53e-47e6-a991-c13102559a27 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:17.912367 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7db16ecd-f53e-47e6-a991-c13102559a27 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:17.912769 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7db16ecd-f53e-47e6-a991-c13102559a27 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:17.913191 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7db16ecd-f53e-47e6-a991-c13102559a27 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:18.046395 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7db16ecd-f53e-47e6-a991-c13102559a27 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:18.054170 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-7db16ecd-f53e-47e6-a991-c13102559a27 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1577 microversion: 2.1 time: 0.155605 Oct 27 17:38:18.054724 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 450/870] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:17 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:18.876750 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3e55d1f6-5fcf-490b-9923-997941e8ecef tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:18.877354 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-3e55d1f6-5fcf-490b-9923-997941e8ecef tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:18.879663 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:38:18.884771 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3e55d1f6-5fcf-490b-9923-997941e8ecef tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:18.885253 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3e55d1f6-5fcf-490b-9923-997941e8ecef tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:18.885693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3e55d1f6-5fcf-490b-9923-997941e8ecef tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:18.886938 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3e55d1f6-5fcf-490b-9923-997941e8ecef tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:18.887379 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3e55d1f6-5fcf-490b-9923-997941e8ecef tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:18.887999 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3e55d1f6-5fcf-490b-9923-997941e8ecef tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:19.023351 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-3e55d1f6-5fcf-490b-9923-997941e8ecef tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:19.031173 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-3e55d1f6-5fcf-490b-9923-997941e8ecef tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 200 len: 1363 microversion: 2.1 time: 0.158229 Oct 27 17:38:19.031796 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 421/871] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:18 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:19.076437 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-9ed65c73-59fe-491d-9498-e1ef9eef3adf tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:19.077160 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-9ed65c73-59fe-491d-9498-e1ef9eef3adf tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:19.083775 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9ed65c73-59fe-491d-9498-e1ef9eef3adf tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:19.084276 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9ed65c73-59fe-491d-9498-e1ef9eef3adf tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:19.084714 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9ed65c73-59fe-491d-9498-e1ef9eef3adf tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:19.085405 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9ed65c73-59fe-491d-9498-e1ef9eef3adf tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:19.085858 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9ed65c73-59fe-491d-9498-e1ef9eef3adf tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:19.086281 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9ed65c73-59fe-491d-9498-e1ef9eef3adf tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:19.228596 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9ed65c73-59fe-491d-9498-e1ef9eef3adf tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:19.237701 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-9ed65c73-59fe-491d-9498-e1ef9eef3adf tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1577 microversion: 2.1 time: 0.165046 Oct 27 17:38:19.238470 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 451/872] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:19 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:20.053439 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-fbcb5d2f-9de3-4ac3-948e-81cc5255de4e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:20.054226 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-fbcb5d2f-9de3-4ac3-948e-81cc5255de4e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:20.061396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fbcb5d2f-9de3-4ac3-948e-81cc5255de4e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:20.061961 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fbcb5d2f-9de3-4ac3-948e-81cc5255de4e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:20.062465 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fbcb5d2f-9de3-4ac3-948e-81cc5255de4e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:20.063229 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fbcb5d2f-9de3-4ac3-948e-81cc5255de4e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:20.063776 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fbcb5d2f-9de3-4ac3-948e-81cc5255de4e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:20.064375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fbcb5d2f-9de3-4ac3-948e-81cc5255de4e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:20.200146 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-fbcb5d2f-9de3-4ac3-948e-81cc5255de4e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:20.207672 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-fbcb5d2f-9de3-4ac3-948e-81cc5255de4e tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 200 len: 1363 microversion: 2.1 time: 0.158091 Oct 27 17:38:20.208264 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 422/873] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:20 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:20.261123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-25e24d66-0503-4245-b45a-d082a95e9ae8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:20.261878 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-25e24d66-0503-4245-b45a-d082a95e9ae8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:20.268215 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-25e24d66-0503-4245-b45a-d082a95e9ae8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:20.268759 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-25e24d66-0503-4245-b45a-d082a95e9ae8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:20.269194 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-25e24d66-0503-4245-b45a-d082a95e9ae8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:20.269906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-25e24d66-0503-4245-b45a-d082a95e9ae8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:20.270351 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-25e24d66-0503-4245-b45a-d082a95e9ae8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:20.270765 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-25e24d66-0503-4245-b45a-d082a95e9ae8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:20.404959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-25e24d66-0503-4245-b45a-d082a95e9ae8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:20.413044 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-25e24d66-0503-4245-b45a-d082a95e9ae8 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1577 microversion: 2.1 time: 0.155766 Oct 27 17:38:20.413709 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 452/874] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:20 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:21.230599 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8ac6f859-30cb-4728-979b-2e793daa060f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:21.231226 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8ac6f859-30cb-4728-979b-2e793daa060f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:21.238307 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ac6f859-30cb-4728-979b-2e793daa060f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:21.238782 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ac6f859-30cb-4728-979b-2e793daa060f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:21.239214 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ac6f859-30cb-4728-979b-2e793daa060f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:21.239923 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ac6f859-30cb-4728-979b-2e793daa060f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:21.240370 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ac6f859-30cb-4728-979b-2e793daa060f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:21.240786 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8ac6f859-30cb-4728-979b-2e793daa060f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:21.377995 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8ac6f859-30cb-4728-979b-2e793daa060f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:21.386436 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8ac6f859-30cb-4728-979b-2e793daa060f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 200 len: 1363 microversion: 2.1 time: 0.159178 Oct 27 17:38:21.386998 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 423/875] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:21 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:21.436207 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1d70348f-ccdd-416d-866b-63eb0dfc9e50 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:21.437000 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-1d70348f-ccdd-416d-866b-63eb0dfc9e50 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:21.443201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1d70348f-ccdd-416d-866b-63eb0dfc9e50 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:21.443701 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1d70348f-ccdd-416d-866b-63eb0dfc9e50 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:21.444150 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1d70348f-ccdd-416d-866b-63eb0dfc9e50 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:21.444841 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1d70348f-ccdd-416d-866b-63eb0dfc9e50 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:21.445296 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1d70348f-ccdd-416d-866b-63eb0dfc9e50 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:21.445720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1d70348f-ccdd-416d-866b-63eb0dfc9e50 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:21.466113 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:38:21.469986 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=10 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:38:21.587892 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1d70348f-ccdd-416d-866b-63eb0dfc9e50 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:21.595534 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1d70348f-ccdd-416d-866b-63eb0dfc9e50 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1577 microversion: 2.1 time: 0.163179 Oct 27 17:38:21.596174 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 453/876] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:21 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:22.007065 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-865e7c35-1b7b-4dfa-bd85-7a45387730af req-bbc66924-5792-482e-a7d7-96676b50c1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b27159-1b55-4d07-95ab-6b31d9376fcc", "name": "network-vif-plugged", "status": "completed", "tag": "fafb856a-ed24-421f-b6a8-a3cb9bd61b71"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:38:22.018357 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=2 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:38:22.021313 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-865e7c35-1b7b-4dfa-bd85-7a45387730af req-bbc66924-5792-482e-a7d7-96676b50c1f1 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:22.022425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-865e7c35-1b7b-4dfa-bd85-7a45387730af req-bbc66924-5792-482e-a7d7-96676b50c1f1 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:22.023193 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-865e7c35-1b7b-4dfa-bd85-7a45387730af req-bbc66924-5792-482e-a7d7-96676b50c1f1 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:22.038113 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-865e7c35-1b7b-4dfa-bd85-7a45387730af req-bbc66924-5792-482e-a7d7-96676b50c1f1 service nova] Creating event network-vif-plugged:fafb856a-ed24-421f-b6a8-a3cb9bd61b71 for instance 93b27159-1b55-4d07-95ab-6b31d9376fcc on hv-cinder-86283 Oct 27 17:38:22.043946 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-865e7c35-1b7b-4dfa-bd85-7a45387730af req-bbc66924-5792-482e-a7d7-96676b50c1f1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041658 Oct 27 17:38:22.044802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 424/877] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:38:22.409927 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-3067e01b-00eb-4533-8d1a-b0bc2416b562 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:22.410549 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-3067e01b-00eb-4533-8d1a-b0bc2416b562 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:22.416850 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3067e01b-00eb-4533-8d1a-b0bc2416b562 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:22.417367 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3067e01b-00eb-4533-8d1a-b0bc2416b562 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:22.417806 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3067e01b-00eb-4533-8d1a-b0bc2416b562 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:22.418531 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3067e01b-00eb-4533-8d1a-b0bc2416b562 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:22.418987 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3067e01b-00eb-4533-8d1a-b0bc2416b562 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:22.419409 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3067e01b-00eb-4533-8d1a-b0bc2416b562 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:22.570672 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-3067e01b-00eb-4533-8d1a-b0bc2416b562 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:22.587508 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-3067e01b-00eb-4533-8d1a-b0bc2416b562 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 200 len: 1363 microversion: 2.1 time: 0.181816 Oct 27 17:38:22.589152 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 454/878] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:22 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:22.619840 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ce56d0cf-892d-488f-82ef-55d6114eec70 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:22.620532 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ce56d0cf-892d-488f-82ef-55d6114eec70 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:22.627923 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce56d0cf-892d-488f-82ef-55d6114eec70 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:22.628683 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce56d0cf-892d-488f-82ef-55d6114eec70 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:22.629229 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce56d0cf-892d-488f-82ef-55d6114eec70 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:22.630011 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce56d0cf-892d-488f-82ef-55d6114eec70 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:22.630565 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce56d0cf-892d-488f-82ef-55d6114eec70 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:22.631215 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce56d0cf-892d-488f-82ef-55d6114eec70 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:22.793240 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ce56d0cf-892d-488f-82ef-55d6114eec70 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:22.801791 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ce56d0cf-892d-488f-82ef-55d6114eec70 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1577 microversion: 2.1 time: 0.187028 Oct 27 17:38:22.802351 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 425/879] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:22 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1577 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:23.614224 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-e07c31d0-075d-45cb-a61e-d6070966968f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:23.615044 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e07c31d0-075d-45cb-a61e-d6070966968f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:23.621466 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e07c31d0-075d-45cb-a61e-d6070966968f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:23.621938 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e07c31d0-075d-45cb-a61e-d6070966968f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:23.622365 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e07c31d0-075d-45cb-a61e-d6070966968f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:23.623053 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e07c31d0-075d-45cb-a61e-d6070966968f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:23.623501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e07c31d0-075d-45cb-a61e-d6070966968f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:23.623957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e07c31d0-075d-45cb-a61e-d6070966968f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:23.769395 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e07c31d0-075d-45cb-a61e-d6070966968f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:23.779171 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-e07c31d0-075d-45cb-a61e-d6070966968f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 200 len: 1363 microversion: 2.1 time: 0.169188 Oct 27 17:38:23.779756 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 455/880] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:23 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:23.828788 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8cd2465f-53b7-4eaa-b7fc-c04b9bf52746 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:23.829532 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8cd2465f-53b7-4eaa-b7fc-c04b9bf52746 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:23.836486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cd2465f-53b7-4eaa-b7fc-c04b9bf52746 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:23.837074 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cd2465f-53b7-4eaa-b7fc-c04b9bf52746 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:23.837615 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cd2465f-53b7-4eaa-b7fc-c04b9bf52746 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:23.838381 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cd2465f-53b7-4eaa-b7fc-c04b9bf52746 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:23.839442 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cd2465f-53b7-4eaa-b7fc-c04b9bf52746 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:23.840055 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cd2465f-53b7-4eaa-b7fc-c04b9bf52746 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:23.988509 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8cd2465f-53b7-4eaa-b7fc-c04b9bf52746 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:23.996197 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8cd2465f-53b7-4eaa-b7fc-c04b9bf52746 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1577 microversion: 2.1 time: 0.173594 Oct 27 17:38:23.996762 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 426/881] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:23 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:24.059111 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-8e467e00-9fbf-4fc6-910e-2b2a952679ac req-fc4cb110-ddd0-4daf-b34e-eb23aa23c099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a883d9-7208-49ab-9775-557bba9f7efd", "name": "network-vif-plugged", "status": "completed", "tag": "469bd0cf-71f5-4704-9199-a07d128929ab"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:38:24.068425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-8e467e00-9fbf-4fc6-910e-2b2a952679ac req-fc4cb110-ddd0-4daf-b34e-eb23aa23c099 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:24.068897 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-8e467e00-9fbf-4fc6-910e-2b2a952679ac req-fc4cb110-ddd0-4daf-b34e-eb23aa23c099 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:24.069324 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-8e467e00-9fbf-4fc6-910e-2b2a952679ac req-fc4cb110-ddd0-4daf-b34e-eb23aa23c099 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:24.080018 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-8e467e00-9fbf-4fc6-910e-2b2a952679ac req-fc4cb110-ddd0-4daf-b34e-eb23aa23c099 service nova] Creating event network-vif-plugged:469bd0cf-71f5-4704-9199-a07d128929ab for instance 26a883d9-7208-49ab-9775-557bba9f7efd on hv-cinder-86283 Oct 27 17:38:24.084663 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-8e467e00-9fbf-4fc6-910e-2b2a952679ac req-fc4cb110-ddd0-4daf-b34e-eb23aa23c099 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029277 Oct 27 17:38:24.085219 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 456/882] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:38:24.801948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-67a36b8b-e41b-481f-8d0c-f2800c3a05e6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:24.802552 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-67a36b8b-e41b-481f-8d0c-f2800c3a05e6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:24.808507 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67a36b8b-e41b-481f-8d0c-f2800c3a05e6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:24.808983 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67a36b8b-e41b-481f-8d0c-f2800c3a05e6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:24.809410 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67a36b8b-e41b-481f-8d0c-f2800c3a05e6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:24.810087 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67a36b8b-e41b-481f-8d0c-f2800c3a05e6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:24.810532 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67a36b8b-e41b-481f-8d0c-f2800c3a05e6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:24.810946 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67a36b8b-e41b-481f-8d0c-f2800c3a05e6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:24.941453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-67a36b8b-e41b-481f-8d0c-f2800c3a05e6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:24.949717 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-67a36b8b-e41b-481f-8d0c-f2800c3a05e6 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 200 len: 1548 microversion: 2.1 time: 0.150996 Oct 27 17:38:24.950283 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 427/883] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:24 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:24.973202 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6b0d3326-2898-42ff-85e0-9070e1a9a1dc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:24.973736 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-6b0d3326-2898-42ff-85e0-9070e1a9a1dc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:24.980247 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b0d3326-2898-42ff-85e0-9070e1a9a1dc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:24.980763 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b0d3326-2898-42ff-85e0-9070e1a9a1dc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:24.981204 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b0d3326-2898-42ff-85e0-9070e1a9a1dc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:24.981930 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b0d3326-2898-42ff-85e0-9070e1a9a1dc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:24.982391 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b0d3326-2898-42ff-85e0-9070e1a9a1dc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:24.982934 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b0d3326-2898-42ff-85e0-9070e1a9a1dc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:25.019975 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-cf93b84b-66e9-430e-b0ae-106bdfa9f28f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:25.020819 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-cf93b84b-66e9-430e-b0ae-106bdfa9f28f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:25.027119 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cf93b84b-66e9-430e-b0ae-106bdfa9f28f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:25.027618 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cf93b84b-66e9-430e-b0ae-106bdfa9f28f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:25.028058 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cf93b84b-66e9-430e-b0ae-106bdfa9f28f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:25.028750 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cf93b84b-66e9-430e-b0ae-106bdfa9f28f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:25.029192 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cf93b84b-66e9-430e-b0ae-106bdfa9f28f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:25.029605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cf93b84b-66e9-430e-b0ae-106bdfa9f28f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:25.065362 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6b0d3326-2898-42ff-85e0-9070e1a9a1dc tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097005 Oct 27 17:38:25.066200 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 457/884] 10.222.0.36 () {58 vars in 1275 bytes} [Thu Oct 27 17:38:24 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:38:25.176571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-cf93b84b-66e9-430e-b0ae-106bdfa9f28f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:25.187428 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-cf93b84b-66e9-430e-b0ae-106bdfa9f28f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1577 microversion: 2.1 time: 0.171407 Oct 27 17:38:25.188241 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 428/885] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:25 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:26.204619 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-46ee2f71-4126-4547-9adf-3f0f8fa70a88 req-856a21ab-2e94-4b95-b846-61e4dd3ebcad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93b27159-1b55-4d07-95ab-6b31d9376fcc", "tag": "fafb856a-ed24-421f-b6a8-a3cb9bd61b71"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:38:26.212352 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9649cad6-0a76-4804-9a63-da90fbc7a130 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:26.213742 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9649cad6-0a76-4804-9a63-da90fbc7a130 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:26.216064 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-46ee2f71-4126-4547-9adf-3f0f8fa70a88 req-856a21ab-2e94-4b95-b846-61e4dd3ebcad service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:26.216724 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-46ee2f71-4126-4547-9adf-3f0f8fa70a88 req-856a21ab-2e94-4b95-b846-61e4dd3ebcad service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:26.217330 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-46ee2f71-4126-4547-9adf-3f0f8fa70a88 req-856a21ab-2e94-4b95-b846-61e4dd3ebcad service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:26.223068 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9649cad6-0a76-4804-9a63-da90fbc7a130 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:26.224134 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9649cad6-0a76-4804-9a63-da90fbc7a130 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:26.224730 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9649cad6-0a76-4804-9a63-da90fbc7a130 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:26.225696 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9649cad6-0a76-4804-9a63-da90fbc7a130 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:26.226620 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9649cad6-0a76-4804-9a63-da90fbc7a130 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:26.227432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9649cad6-0a76-4804-9a63-da90fbc7a130 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:26.230309 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-46ee2f71-4126-4547-9adf-3f0f8fa70a88 req-856a21ab-2e94-4b95-b846-61e4dd3ebcad service nova] Creating event network-changed:fafb856a-ed24-421f-b6a8-a3cb9bd61b71 for instance 93b27159-1b55-4d07-95ab-6b31d9376fcc on hv-cinder-86283 Oct 27 17:38:26.235473 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-46ee2f71-4126-4547-9adf-3f0f8fa70a88 req-856a21ab-2e94-4b95-b846-61e4dd3ebcad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034830 Oct 27 17:38:26.236779 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 458/886] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:38:26.388869 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9649cad6-0a76-4804-9a63-da90fbc7a130 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:26.397479 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9649cad6-0a76-4804-9a63-da90fbc7a130 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1577 microversion: 2.1 time: 0.189141 Oct 27 17:38:26.398057 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 429/887] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:26 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:38:27.422726 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8407bc0b-0f06-479a-bbde-dee3ec1404ff tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:38:27.423654 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8407bc0b-0f06-479a-bbde-dee3ec1404ff tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:38:27.429997 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8407bc0b-0f06-479a-bbde-dee3ec1404ff tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:27.430721 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8407bc0b-0f06-479a-bbde-dee3ec1404ff tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:27.431163 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8407bc0b-0f06-479a-bbde-dee3ec1404ff tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:27.431895 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8407bc0b-0f06-479a-bbde-dee3ec1404ff tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:38:27.432350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8407bc0b-0f06-479a-bbde-dee3ec1404ff tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:38:27.432776 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8407bc0b-0f06-479a-bbde-dee3ec1404ff tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:38:27.571623 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8407bc0b-0f06-479a-bbde-dee3ec1404ff tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:38:27.581605 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8407bc0b-0f06-479a-bbde-dee3ec1404ff tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1564 microversion: 2.1 time: 0.163734 Oct 27 17:38:27.582182 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 459/888] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:38:27 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:39:05.835190 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ce6aeb1b-0366-4278-895d-eecb111ba641 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:05.835776 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ce6aeb1b-0366-4278-895d-eecb111ba641 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:05.837865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=17 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:39:05.838513 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=64 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:39:05.846013 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce6aeb1b-0366-4278-895d-eecb111ba641 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:05.846496 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce6aeb1b-0366-4278-895d-eecb111ba641 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:05.846929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce6aeb1b-0366-4278-895d-eecb111ba641 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:05.847615 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce6aeb1b-0366-4278-895d-eecb111ba641 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:05.848334 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce6aeb1b-0366-4278-895d-eecb111ba641 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:05.848772 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ce6aeb1b-0366-4278-895d-eecb111ba641 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:05.872659 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ce6aeb1b-0366-4278-895d-eecb111ba641 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746/ips" status: 200 len: 150 microversion: 2.20 time: 0.041431 Oct 27 17:39:05.873257 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 430/889] 10.222.0.36 () {60 vars in 1289 bytes} [Thu Oct 27 17:39:05 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:39:07.031783 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-101b7b9e-b490-4f0b-8e9b-5453f5ce41dc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:07.032349 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-101b7b9e-b490-4f0b-8e9b-5453f5ce41dc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:07.034455 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:39:07.035117 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=96 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:39:07.041692 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-101b7b9e-b490-4f0b-8e9b-5453f5ce41dc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:07.042180 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-101b7b9e-b490-4f0b-8e9b-5453f5ce41dc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:07.042622 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-101b7b9e-b490-4f0b-8e9b-5453f5ce41dc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:07.043658 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-101b7b9e-b490-4f0b-8e9b-5453f5ce41dc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:07.043853 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-101b7b9e-b490-4f0b-8e9b-5453f5ce41dc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:07.044227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-101b7b9e-b490-4f0b-8e9b-5453f5ce41dc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:07.068918 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-101b7b9e-b490-4f0b-8e9b-5453f5ce41dc tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246/ips" status: 200 len: 149 microversion: 2.1 time: 0.041240 Oct 27 17:39:07.069482 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 460/890] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Oct 27 17:39:07 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:39:12.615827 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-5ca20b66-9c69-43c5-a236-0cc612cee49b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0459b101-8306-4acf-b19b-9b668c80a1df"}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:39:12.618217 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-5ca20b66-9c69-43c5-a236-0cc612cee49b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:12.625239 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5ca20b66-9c69-43c5-a236-0cc612cee49b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:12.625718 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5ca20b66-9c69-43c5-a236-0cc612cee49b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:12.626145 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5ca20b66-9c69-43c5-a236-0cc612cee49b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:12.626828 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5ca20b66-9c69-43c5-a236-0cc612cee49b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:12.627272 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5ca20b66-9c69-43c5-a236-0cc612cee49b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:12.627692 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5ca20b66-9c69-43c5-a236-0cc612cee49b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:12.944164 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-5ca20b66-9c69-43c5-a236-0cc612cee49b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "POST /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332058 Oct 27 17:39:12.950377 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 431/891] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Oct 27 17:39:12 2022] POST /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:39:13.034631 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-106c5a52-7e1b-453e-bc51-99a9a8efce1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:39:13.035231 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-106c5a52-7e1b-453e-bc51-99a9a8efce1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:13.042080 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-106c5a52-7e1b-453e-bc51-99a9a8efce1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:13.042568 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-106c5a52-7e1b-453e-bc51-99a9a8efce1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:13.043017 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-106c5a52-7e1b-453e-bc51-99a9a8efce1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:13.043740 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-106c5a52-7e1b-453e-bc51-99a9a8efce1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:13.044241 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-106c5a52-7e1b-453e-bc51-99a9a8efce1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:13.050503 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-106c5a52-7e1b-453e-bc51-99a9a8efce1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:13.070882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.objects.instance [None req-106c5a52-7e1b-453e-bc51-99a9a8efce1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lazy-loading 'flavor' on Instance uuid bef8a04a-8ed9-43bd-8a43-8ed991b5d746 {{(pid=119047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:39:13.266412 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-106c5a52-7e1b-453e-bc51-99a9a8efce1f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "POST /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746/action" status: 202 len: 0 microversion: 2.20 time: 0.235642 Oct 27 17:39:13.267217 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 461/892] 10.222.0.36 () {62 vars in 1319 bytes} [Thu Oct 27 17:39:13 2022] POST /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:39:13.276926 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e307041f-d760-40d7-b0c7-0f9ffcd1cb3e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:13.277687 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e307041f-d760-40d7-b0c7-0f9ffcd1cb3e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:13.288215 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e307041f-d760-40d7-b0c7-0f9ffcd1cb3e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:13.289155 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e307041f-d760-40d7-b0c7-0f9ffcd1cb3e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:13.289672 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e307041f-d760-40d7-b0c7-0f9ffcd1cb3e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:13.290554 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e307041f-d760-40d7-b0c7-0f9ffcd1cb3e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:13.291188 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e307041f-d760-40d7-b0c7-0f9ffcd1cb3e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:13.291630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e307041f-d760-40d7-b0c7-0f9ffcd1cb3e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:13.425432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e307041f-d760-40d7-b0c7-0f9ffcd1cb3e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:13.433632 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e307041f-d760-40d7-b0c7-0f9ffcd1cb3e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:13.435080 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e307041f-d760-40d7-b0c7-0f9ffcd1cb3e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:13.436277 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e307041f-d760-40d7-b0c7-0f9ffcd1cb3e tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1723 microversion: 2.20 time: 0.164478 Oct 27 17:39:13.436833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 432/893] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:13 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:14.464380 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-926bf1e7-be0c-40cf-aab1-3be59737e9e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:14.465572 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-926bf1e7-be0c-40cf-aab1-3be59737e9e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:14.473543 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-926bf1e7-be0c-40cf-aab1-3be59737e9e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:14.474022 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-926bf1e7-be0c-40cf-aab1-3be59737e9e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:14.474454 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-926bf1e7-be0c-40cf-aab1-3be59737e9e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:14.475137 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-926bf1e7-be0c-40cf-aab1-3be59737e9e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:14.475586 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-926bf1e7-be0c-40cf-aab1-3be59737e9e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:14.476026 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-926bf1e7-be0c-40cf-aab1-3be59737e9e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:14.607990 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-926bf1e7-be0c-40cf-aab1-3be59737e9e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:14.616100 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-926bf1e7-be0c-40cf-aab1-3be59737e9e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:14.617533 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-926bf1e7-be0c-40cf-aab1-3be59737e9e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:14.618685 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-926bf1e7-be0c-40cf-aab1-3be59737e9e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1723 microversion: 2.20 time: 0.160409 Oct 27 17:39:14.619240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 462/894] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:14 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:15.645078 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b6df7900-ffaa-4078-903a-b50a19b53de5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:15.645680 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b6df7900-ffaa-4078-903a-b50a19b53de5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:15.652100 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6df7900-ffaa-4078-903a-b50a19b53de5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:15.652576 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6df7900-ffaa-4078-903a-b50a19b53de5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:15.653006 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6df7900-ffaa-4078-903a-b50a19b53de5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:15.654314 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6df7900-ffaa-4078-903a-b50a19b53de5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:15.654763 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6df7900-ffaa-4078-903a-b50a19b53de5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:15.655181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b6df7900-ffaa-4078-903a-b50a19b53de5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:15.782047 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b6df7900-ffaa-4078-903a-b50a19b53de5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:15.790029 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b6df7900-ffaa-4078-903a-b50a19b53de5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:15.791441 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b6df7900-ffaa-4078-903a-b50a19b53de5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:15.792618 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b6df7900-ffaa-4078-903a-b50a19b53de5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1723 microversion: 2.20 time: 0.151522 Oct 27 17:39:15.793181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 433/895] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:15 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:16.818316 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-44b2e6d1-4573-458c-b0c9-062a1dc2d8d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:16.818932 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-44b2e6d1-4573-458c-b0c9-062a1dc2d8d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:16.825539 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-44b2e6d1-4573-458c-b0c9-062a1dc2d8d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:16.826012 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-44b2e6d1-4573-458c-b0c9-062a1dc2d8d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:16.826448 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-44b2e6d1-4573-458c-b0c9-062a1dc2d8d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:16.827146 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-44b2e6d1-4573-458c-b0c9-062a1dc2d8d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:16.827602 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-44b2e6d1-4573-458c-b0c9-062a1dc2d8d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:16.828055 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-44b2e6d1-4573-458c-b0c9-062a1dc2d8d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:16.965490 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-44b2e6d1-4573-458c-b0c9-062a1dc2d8d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:16.976313 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-44b2e6d1-4573-458c-b0c9-062a1dc2d8d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:16.978050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-44b2e6d1-4573-458c-b0c9-062a1dc2d8d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:16.979053 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-44b2e6d1-4573-458c-b0c9-062a1dc2d8d6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1723 microversion: 2.20 time: 0.164721 Oct 27 17:39:16.979588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 463/896] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:16 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:18.004303 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-80b541cf-48c8-4423-86d3-becf551088d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:18.004911 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-80b541cf-48c8-4423-86d3-becf551088d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:18.011389 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-80b541cf-48c8-4423-86d3-becf551088d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:18.011903 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-80b541cf-48c8-4423-86d3-becf551088d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:18.012339 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-80b541cf-48c8-4423-86d3-becf551088d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:18.013021 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-80b541cf-48c8-4423-86d3-becf551088d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:18.013467 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-80b541cf-48c8-4423-86d3-becf551088d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:18.013885 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-80b541cf-48c8-4423-86d3-becf551088d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:18.139469 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-80b541cf-48c8-4423-86d3-becf551088d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:18.147354 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-80b541cf-48c8-4423-86d3-becf551088d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:18.148818 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-80b541cf-48c8-4423-86d3-becf551088d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:18.149966 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-80b541cf-48c8-4423-86d3-becf551088d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1723 microversion: 2.20 time: 0.149596 Oct 27 17:39:18.150522 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 434/897] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:17 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:19.176077 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-fdb9def5-9d40-47ce-9dae-a2c87417b8ab tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:19.176688 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-fdb9def5-9d40-47ce-9dae-a2c87417b8ab tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:19.183205 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fdb9def5-9d40-47ce-9dae-a2c87417b8ab tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:19.183685 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fdb9def5-9d40-47ce-9dae-a2c87417b8ab tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:19.184145 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fdb9def5-9d40-47ce-9dae-a2c87417b8ab tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:19.184825 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fdb9def5-9d40-47ce-9dae-a2c87417b8ab tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:19.185276 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fdb9def5-9d40-47ce-9dae-a2c87417b8ab tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:19.185695 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fdb9def5-9d40-47ce-9dae-a2c87417b8ab tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:19.314855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fdb9def5-9d40-47ce-9dae-a2c87417b8ab tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:19.322938 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fdb9def5-9d40-47ce-9dae-a2c87417b8ab tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:19.324415 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fdb9def5-9d40-47ce-9dae-a2c87417b8ab tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:19.326078 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-fdb9def5-9d40-47ce-9dae-a2c87417b8ab tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1723 microversion: 2.20 time: 0.154032 Oct 27 17:39:19.326632 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 464/898] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:19 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:20.352362 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-11e20c44-dd22-45f7-8e61-09cbac8c0571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:20.352927 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-11e20c44-dd22-45f7-8e61-09cbac8c0571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:20.360062 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-11e20c44-dd22-45f7-8e61-09cbac8c0571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:20.360539 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-11e20c44-dd22-45f7-8e61-09cbac8c0571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:20.360970 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-11e20c44-dd22-45f7-8e61-09cbac8c0571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:20.361678 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-11e20c44-dd22-45f7-8e61-09cbac8c0571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:20.362155 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-11e20c44-dd22-45f7-8e61-09cbac8c0571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:20.362572 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-11e20c44-dd22-45f7-8e61-09cbac8c0571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:20.498639 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-11e20c44-dd22-45f7-8e61-09cbac8c0571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:20.507520 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-11e20c44-dd22-45f7-8e61-09cbac8c0571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:20.509003 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-11e20c44-dd22-45f7-8e61-09cbac8c0571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:20.510195 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-11e20c44-dd22-45f7-8e61-09cbac8c0571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1723 microversion: 2.20 time: 0.162863 Oct 27 17:39:20.510771 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 435/899] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:20 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:20.636694 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f280c7e7-4f83-4b58-bd1d-0bb5504af4e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0459b101-8306-4acf-b19b-9b668c80a1df"}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:39:20.639110 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f280c7e7-4f83-4b58-bd1d-0bb5504af4e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:20.645506 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f280c7e7-4f83-4b58-bd1d-0bb5504af4e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:20.645989 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f280c7e7-4f83-4b58-bd1d-0bb5504af4e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:20.646421 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f280c7e7-4f83-4b58-bd1d-0bb5504af4e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:20.647104 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f280c7e7-4f83-4b58-bd1d-0bb5504af4e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:20.647555 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f280c7e7-4f83-4b58-bd1d-0bb5504af4e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:20.648011 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f280c7e7-4f83-4b58-bd1d-0bb5504af4e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:20.726351 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-f280c7e7-4f83-4b58-bd1d-0bb5504af4e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] HTTP exception thrown: Invalid volume: volume 0459b101-8306-4acf-b19b-9b668c80a1df is already attached to instances: be393ea8-0e26-4c60-8b50-bab24362d246 Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f280c7e7-4f83-4b58-bd1d-0bb5504af4e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Request method failure captured: Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: POST /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246/os-volume_attachments HTTP/1.1 Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 74 Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA48P867QnVFetJM_7-4A7Zzy1y_BgK92PPcM5QN2sMM7rFRhLUgPfG-i71JivsPG4LadkJJ4XcZlaVkMTt9ACmFBCVr55uoiFNCoOee5ZYSDumbUSBNjRpORNBa4HVT1DYjC6OvQXdJDtZsCkYaDUqFgRE6zbJPygnGePlokMgMzQ Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:39:20.728084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:39:20.729796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}] Oct 27 17:39:20.729796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:39:20.729796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:39:20.729796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:39:20.729796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:39:20.729796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:39:20.729796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:39:20.729796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 3c36ea3a53cc48fa996891e3c6ddfda8 Oct 27 17:39:20.729796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:39:20.729796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Oct 27 17:39:20.729796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {"volumeAttachment": {"volumeId": "0459b101-8306-4acf-b19b-9b668c80a1df"}} Oct 27 17:39:20.729796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Invalid volume: volume 0459b101-8306-4acf-b19b-9b668c80a1df is already attached to instances: be393ea8-0e26-4c60-8b50-bab24362d246 Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'server_id': 'be393ea8-0e26-4c60-8b50-bab24362d246', 'body': {'volumeAttachment': {'volumeId': '0459b101-8306-4acf-b19b-9b668c80a1df'}}} Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0459b101-8306-4acf-b19b-9b668c80a1df is already attached to instances: be393ea8-0e26-4c60-8b50-bab24362d246 Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:39:20.730851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0459b101-8306-4acf-b19b-9b668c80a1df is already attached to instances: be393ea8-0e26-4c60-8b50-bab24362d246 Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:39:20.732361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:39:20.733911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:39:20.733911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:39:20.733911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:39:20.733911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0459b101-8306-4acf-b19b-9b668c80a1df is already attached to instances: be393ea8-0e26-4c60-8b50-bab24362d246 Oct 27 17:39:20.733911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:39:20.733911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f280c7e7-4f83-4b58-bd1d-0bb5504af4e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Returning 400 to user: Invalid volume: volume 0459b101-8306-4acf-b19b-9b668c80a1df is already attached to instances: be393ea8-0e26-4c60-8b50-bab24362d246 {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:39:20.733911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f280c7e7-4f83-4b58-bd1d-0bb5504af4e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "POST /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096874 Oct 27 17:39:20.733911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 465/900] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Oct 27 17:39:20 2022] POST /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 17:39:20.793741 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4a4a8033-92be-479a-a3d9-a1c6cc51c068 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:20.794230 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4a4a8033-92be-479a-a3d9-a1c6cc51c068 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:20.800091 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4a4a8033-92be-479a-a3d9-a1c6cc51c068 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:20.800572 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4a4a8033-92be-479a-a3d9-a1c6cc51c068 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:20.801001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4a4a8033-92be-479a-a3d9-a1c6cc51c068 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:20.801681 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4a4a8033-92be-479a-a3d9-a1c6cc51c068 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:20.802132 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4a4a8033-92be-479a-a3d9-a1c6cc51c068 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:20.802550 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4a4a8033-92be-479a-a3d9-a1c6cc51c068 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:20.880676 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-4a4a8033-92be-479a-a3d9-a1c6cc51c068 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lazy-loading 'services' on Instance uuid be393ea8-0e26-4c60-8b50-bab24362d246 {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:39:20.949957 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4a4a8033-92be-479a-a3d9-a1c6cc51c068 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "DELETE /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246/os-volume_attachments/0459b101-8306-4acf-b19b-9b668c80a1df" status: 202 len: 0 microversion: 2.1 time: 0.159889 Oct 27 17:39:20.950539 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 436/901] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Oct 27 17:39:20 2022] DELETE /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246/os-volume_attachments/0459b101-8306-4acf-b19b-9b668c80a1df => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:39:20.959304 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-75a3a3e4-2086-4d32-8077-565e78f34497 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:20.961465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-75a3a3e4-2086-4d32-8077-565e78f34497 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:20.971784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75a3a3e4-2086-4d32-8077-565e78f34497 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:20.972645 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75a3a3e4-2086-4d32-8077-565e78f34497 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:20.973260 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75a3a3e4-2086-4d32-8077-565e78f34497 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:20.973961 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75a3a3e4-2086-4d32-8077-565e78f34497 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:20.974407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75a3a3e4-2086-4d32-8077-565e78f34497 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:20.974831 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-75a3a3e4-2086-4d32-8077-565e78f34497 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:21.004010 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-75a3a3e4-2086-4d32-8077-565e78f34497 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048549 Oct 27 17:39:21.004568 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 466/902] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:39:20 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:39:21.536464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a41da159-17f7-4531-89ba-f63c76610f23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:21.537173 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a41da159-17f7-4531-89ba-f63c76610f23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:21.543232 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a41da159-17f7-4531-89ba-f63c76610f23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:21.543743 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a41da159-17f7-4531-89ba-f63c76610f23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:21.544190 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a41da159-17f7-4531-89ba-f63c76610f23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:21.545365 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a41da159-17f7-4531-89ba-f63c76610f23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:21.545817 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a41da159-17f7-4531-89ba-f63c76610f23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:21.546240 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a41da159-17f7-4531-89ba-f63c76610f23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:21.680534 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a41da159-17f7-4531-89ba-f63c76610f23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:21.689004 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a41da159-17f7-4531-89ba-f63c76610f23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:21.690547 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-a41da159-17f7-4531-89ba-f63c76610f23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:21.691768 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a41da159-17f7-4531-89ba-f63c76610f23 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1723 microversion: 2.20 time: 0.160064 Oct 27 17:39:21.692325 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 437/903] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:21 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:22.016814 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b59034e8-8f96-42eb-8a77-0cb754b925cb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:22.018986 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b59034e8-8f96-42eb-8a77-0cb754b925cb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:22.025391 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b59034e8-8f96-42eb-8a77-0cb754b925cb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:22.025870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b59034e8-8f96-42eb-8a77-0cb754b925cb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:22.026303 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b59034e8-8f96-42eb-8a77-0cb754b925cb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:22.027023 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b59034e8-8f96-42eb-8a77-0cb754b925cb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:22.027476 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b59034e8-8f96-42eb-8a77-0cb754b925cb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:22.027928 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b59034e8-8f96-42eb-8a77-0cb754b925cb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:22.055829 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b59034e8-8f96-42eb-8a77-0cb754b925cb tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043711 Oct 27 17:39:22.056374 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 467/904] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:39:22 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 17:39:22.118726 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-edb5c8d2-959a-4008-8698-d719bd5ac208 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:22.119214 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-edb5c8d2-959a-4008-8698-d719bd5ac208 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:22.125734 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-edb5c8d2-959a-4008-8698-d719bd5ac208 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:22.126204 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-edb5c8d2-959a-4008-8698-d719bd5ac208 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:22.126631 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-edb5c8d2-959a-4008-8698-d719bd5ac208 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:22.127301 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-edb5c8d2-959a-4008-8698-d719bd5ac208 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:22.127772 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-edb5c8d2-959a-4008-8698-d719bd5ac208 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:22.128189 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-edb5c8d2-959a-4008-8698-d719bd5ac208 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:22.152755 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-edb5c8d2-959a-4008-8698-d719bd5ac208 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Going to try to terminate instance {{(pid=119046) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:39:22.225618 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-edb5c8d2-959a-4008-8698-d719bd5ac208 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "DELETE /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 204 len: 0 microversion: 2.1 time: 0.110382 Oct 27 17:39:22.226122 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 438/905] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:39:22 2022] DELETE /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:39:22.235534 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c7f23d11-9668-42a3-b375-729b98cd0448 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:22.236167 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c7f23d11-9668-42a3-b375-729b98cd0448 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:22.241999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c7f23d11-9668-42a3-b375-729b98cd0448 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:22.242473 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c7f23d11-9668-42a3-b375-729b98cd0448 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:22.242903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c7f23d11-9668-42a3-b375-729b98cd0448 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:22.243582 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c7f23d11-9668-42a3-b375-729b98cd0448 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:22.244061 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c7f23d11-9668-42a3-b375-729b98cd0448 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:22.244480 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c7f23d11-9668-42a3-b375-729b98cd0448 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:22.370982 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c7f23d11-9668-42a3-b375-729b98cd0448 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:22.379287 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c7f23d11-9668-42a3-b375-729b98cd0448 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1681 microversion: 2.1 time: 0.148110 Oct 27 17:39:22.380038 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 468/906] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:22 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:39:22.719202 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6586e957-26e4-4908-89f2-e4094b6b79a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:22.719934 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6586e957-26e4-4908-89f2-e4094b6b79a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:22.726550 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6586e957-26e4-4908-89f2-e4094b6b79a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:22.727028 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6586e957-26e4-4908-89f2-e4094b6b79a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:22.727461 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6586e957-26e4-4908-89f2-e4094b6b79a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:22.728250 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6586e957-26e4-4908-89f2-e4094b6b79a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:22.728700 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6586e957-26e4-4908-89f2-e4094b6b79a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:22.729119 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6586e957-26e4-4908-89f2-e4094b6b79a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:22.859843 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-6586e957-26e4-4908-89f2-e4094b6b79a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:22.869880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-6586e957-26e4-4908-89f2-e4094b6b79a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:22.871453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-6586e957-26e4-4908-89f2-e4094b6b79a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:22.872665 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6586e957-26e4-4908-89f2-e4094b6b79a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1723 microversion: 2.20 time: 0.158237 Oct 27 17:39:22.873224 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 439/907] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:22 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:23.402356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4544777d-3592-44d4-a956-b9380c365899 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:23.403006 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4544777d-3592-44d4-a956-b9380c365899 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:23.409472 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4544777d-3592-44d4-a956-b9380c365899 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:23.409952 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4544777d-3592-44d4-a956-b9380c365899 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:23.410383 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4544777d-3592-44d4-a956-b9380c365899 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:23.411072 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4544777d-3592-44d4-a956-b9380c365899 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:23.411516 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4544777d-3592-44d4-a956-b9380c365899 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:23.411961 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4544777d-3592-44d4-a956-b9380c365899 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:23.539722 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4544777d-3592-44d4-a956-b9380c365899 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:23.547449 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4544777d-3592-44d4-a956-b9380c365899 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1681 microversion: 2.1 time: 0.149029 Oct 27 17:39:23.548049 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 469/908] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:23 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:39:23.898159 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-43e2906c-c60c-4a53-af72-6f3a52b19424 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:23.898704 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-43e2906c-c60c-4a53-af72-6f3a52b19424 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:23.905011 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43e2906c-c60c-4a53-af72-6f3a52b19424 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:23.905481 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43e2906c-c60c-4a53-af72-6f3a52b19424 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:23.905908 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43e2906c-c60c-4a53-af72-6f3a52b19424 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:23.906582 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43e2906c-c60c-4a53-af72-6f3a52b19424 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:23.907025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43e2906c-c60c-4a53-af72-6f3a52b19424 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:23.907439 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-43e2906c-c60c-4a53-af72-6f3a52b19424 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:24.036679 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-43e2906c-c60c-4a53-af72-6f3a52b19424 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:24.045249 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-43e2906c-c60c-4a53-af72-6f3a52b19424 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:24.046674 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-43e2906c-c60c-4a53-af72-6f3a52b19424 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:24.047838 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-43e2906c-c60c-4a53-af72-6f3a52b19424 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1723 microversion: 2.20 time: 0.153856 Oct 27 17:39:24.048390 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 440/909] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:23 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:24.570462 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-770db51f-fc99-4b33-95ac-2175bc80c3ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:24.571157 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-770db51f-fc99-4b33-95ac-2175bc80c3ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:24.578297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-770db51f-fc99-4b33-95ac-2175bc80c3ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:24.578784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-770db51f-fc99-4b33-95ac-2175bc80c3ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:24.579435 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-770db51f-fc99-4b33-95ac-2175bc80c3ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:24.579929 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-770db51f-fc99-4b33-95ac-2175bc80c3ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:24.580380 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-770db51f-fc99-4b33-95ac-2175bc80c3ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:24.580797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-770db51f-fc99-4b33-95ac-2175bc80c3ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:24.709283 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-770db51f-fc99-4b33-95ac-2175bc80c3ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:24.717548 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-770db51f-fc99-4b33-95ac-2175bc80c3ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1681 microversion: 2.1 time: 0.150994 Oct 27 17:39:24.718111 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 470/910] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:24 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:39:25.073366 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f62363f4-22c2-447c-aac7-6e85d12e9f22 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:25.073911 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-f62363f4-22c2-447c-aac7-6e85d12e9f22 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:25.081330 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f62363f4-22c2-447c-aac7-6e85d12e9f22 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:25.082250 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f62363f4-22c2-447c-aac7-6e85d12e9f22 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:25.082856 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f62363f4-22c2-447c-aac7-6e85d12e9f22 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:25.084225 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f62363f4-22c2-447c-aac7-6e85d12e9f22 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:25.084682 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f62363f4-22c2-447c-aac7-6e85d12e9f22 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:25.085205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f62363f4-22c2-447c-aac7-6e85d12e9f22 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:25.321893 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f62363f4-22c2-447c-aac7-6e85d12e9f22 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:25.325151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-2961badf-7c53-4494-8194-7c07b97f2d5f req-9d74cae1-287b-41e3-bd8b-f5c4ad373962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be393ea8-0e26-4c60-8b50-bab24362d246", "name": "network-vif-deleted", "tag": "cf522c5e-a944-4450-8095-8875d39f901e"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:39:25.338773 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-2961badf-7c53-4494-8194-7c07b97f2d5f req-9d74cae1-287b-41e3-bd8b-f5c4ad373962 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:25.339585 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-2961badf-7c53-4494-8194-7c07b97f2d5f req-9d74cae1-287b-41e3-bd8b-f5c4ad373962 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:25.340220 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-2961badf-7c53-4494-8194-7c07b97f2d5f req-9d74cae1-287b-41e3-bd8b-f5c4ad373962 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:25.341323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f62363f4-22c2-447c-aac7-6e85d12e9f22 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:25.343403 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f62363f4-22c2-447c-aac7-6e85d12e9f22 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:25.345879 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f62363f4-22c2-447c-aac7-6e85d12e9f22 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1723 microversion: 2.20 time: 0.276451 Oct 27 17:39:25.347086 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 441/911] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:25 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:25.354406 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-2961badf-7c53-4494-8194-7c07b97f2d5f req-9d74cae1-287b-41e3-bd8b-f5c4ad373962 service nova] Creating event network-vif-deleted:cf522c5e-a944-4450-8095-8875d39f901e for instance be393ea8-0e26-4c60-8b50-bab24362d246 on hv-cinder-86283 Oct 27 17:39:25.360486 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-2961badf-7c53-4494-8194-7c07b97f2d5f req-9d74cae1-287b-41e3-bd8b-f5c4ad373962 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039908 Oct 27 17:39:25.367922 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 471/912] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:39:25.741004 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-35be77da-b6a0-47ad-a8a7-de3b3e9fc7d9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:25.741645 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-35be77da-b6a0-47ad-a8a7-de3b3e9fc7d9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:25.748285 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-35be77da-b6a0-47ad-a8a7-de3b3e9fc7d9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:25.748836 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-35be77da-b6a0-47ad-a8a7-de3b3e9fc7d9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:25.749350 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-35be77da-b6a0-47ad-a8a7-de3b3e9fc7d9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:25.750112 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-35be77da-b6a0-47ad-a8a7-de3b3e9fc7d9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:25.750657 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-35be77da-b6a0-47ad-a8a7-de3b3e9fc7d9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:25.751107 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-35be77da-b6a0-47ad-a8a7-de3b3e9fc7d9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:25.783018 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-35be77da-b6a0-47ad-a8a7-de3b3e9fc7d9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:25.783491 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-35be77da-b6a0-47ad-a8a7-de3b3e9fc7d9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:25.783946 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-35be77da-b6a0-47ad-a8a7-de3b3e9fc7d9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:25.784385 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-35be77da-b6a0-47ad-a8a7-de3b3e9fc7d9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lazy-loading 'fault' on Instance uuid be393ea8-0e26-4c60-8b50-bab24362d246 {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:39:25.831310 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-35be77da-b6a0-47ad-a8a7-de3b3e9fc7d9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:25.835372 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:39:25.842188 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-35be77da-b6a0-47ad-a8a7-de3b3e9fc7d9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 200 len: 1332 microversion: 2.1 time: 0.104537 Oct 27 17:39:25.842975 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 442/913] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:25 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:39:26.374275 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2f587e35-9894-435b-a0cb-71351efb2099 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:26.374895 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2f587e35-9894-435b-a0cb-71351efb2099 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:26.381377 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2f587e35-9894-435b-a0cb-71351efb2099 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:26.381866 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2f587e35-9894-435b-a0cb-71351efb2099 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:26.382304 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2f587e35-9894-435b-a0cb-71351efb2099 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:26.383003 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2f587e35-9894-435b-a0cb-71351efb2099 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:26.383456 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2f587e35-9894-435b-a0cb-71351efb2099 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:26.383938 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2f587e35-9894-435b-a0cb-71351efb2099 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:26.515950 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2f587e35-9894-435b-a0cb-71351efb2099 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:26.523993 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2f587e35-9894-435b-a0cb-71351efb2099 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:26.525437 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2f587e35-9894-435b-a0cb-71351efb2099 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:26.526593 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2f587e35-9894-435b-a0cb-71351efb2099 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1744 microversion: 2.20 time: 0.157753 Oct 27 17:39:26.527146 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 472/914] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:26 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:26.865670 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-67d78afd-5340-4464-8a39-a33b72515bc9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:26.866321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-67d78afd-5340-4464-8a39-a33b72515bc9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:26.874737 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67d78afd-5340-4464-8a39-a33b72515bc9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:26.876132 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67d78afd-5340-4464-8a39-a33b72515bc9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:26.877355 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67d78afd-5340-4464-8a39-a33b72515bc9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:26.877688 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67d78afd-5340-4464-8a39-a33b72515bc9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:26.878363 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67d78afd-5340-4464-8a39-a33b72515bc9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:26.878964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-67d78afd-5340-4464-8a39-a33b72515bc9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:26.893647 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-67d78afd-5340-4464-8a39-a33b72515bc9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] HTTP exception thrown: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-67d78afd-5340-4464-8a39-a33b72515bc9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Request method failure captured: Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 HTTP/1.1 Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA48P867QnVFetJM_7-4A7Zzy1y_BgK92PPcM5QN2sMM7rFRhLUgPfG-i71JivsPG4LadkJJ4XcZlaVkMTt9ACmFBCVr55uoiFNCoOee5ZYSDumbUSBNjRpORNBa4HVT1DYjC6OvQXdJDtZsCkYaDUqFgRE6zbJPygnGePlokMgMzQ Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:39:26.895281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:39:26.896942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}] Oct 27 17:39:26.896942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:39:26.896942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:39:26.896942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:39:26.896942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:39:26.896942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:39:26.896942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:39:26.896942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 3c36ea3a53cc48fa996891e3c6ddfda8 Oct 27 17:39:26.896942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:39:26.896942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:39:26.896942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. Oct 27 17:39:26.896942 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': 'be393ea8-0e26-4c60-8b50-bab24362d246'} Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:39:26.897841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. Oct 27 17:39:26.899199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:39:26.900477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-67d78afd-5340-4464-8a39-a33b72515bc9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Returning 404 to user: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:39:26.900477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-67d78afd-5340-4464-8a39-a33b72515bc9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 404 len: 111 microversion: 2.1 time: 0.034915 Oct 27 17:39:26.900477 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 443/915] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:26 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 17:39:26.905720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a10e6e8a-64c8-4a8c-a4fa-de636ace9b30 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '.version_select at 0x7f078bf37c10>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:26.924447 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a10e6e8a-64c8-4a8c-a4fa-de636ace9b30 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097089373" status: 202 len: 0 microversion: 2.1 time: 0.022673 Oct 27 17:39:26.924988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 473/916] 10.222.0.36 () {58 vars in 1221 bytes} [Thu Oct 27 17:39:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097089373 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:39:27.522815 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-884c2fee-3cc7-4358-a249-9901110c5cea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Action: 'create', calling method: .version_select at 0x7f078855b430>, body: {"keypair": {"name": "tempest-keypair-1618499157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGgF2chJXpqhdr7MaP5iP8aDrBxbA/lA1AroeLQnRtJ2t2N7f5xVFYdm6pcUrTc8awyYV/gJ0VWFlntmwzM7KGOEkwRswiHpjqB25NIqRYOtteS0J+3ICtDQomL0kNxNg=="}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:39:27.538857 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-884c2fee-3cc7-4358-a249-9901110c5cea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Getting quotas for project a35c2b53ccb445d4b0dd2915376f69cf. Resources: {'key_pairs'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:39:27.542716 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-884c2fee-3cc7-4358-a249-9901110c5cea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Getting quotas for user 3c36ea3a53cc48fa996891e3c6ddfda8 and project a35c2b53ccb445d4b0dd2915376f69cf. Resources: {'key_pairs'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:39:27.551638 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-039a0b94-c68a-4820-957b-b2e2eb636363 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:27.553002 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-039a0b94-c68a-4820-957b-b2e2eb636363 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:27.561104 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-039a0b94-c68a-4820-957b-b2e2eb636363 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:27.561730 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-039a0b94-c68a-4820-957b-b2e2eb636363 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:27.562227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-039a0b94-c68a-4820-957b-b2e2eb636363 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:27.563045 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-039a0b94-c68a-4820-957b-b2e2eb636363 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:27.563990 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-039a0b94-c68a-4820-957b-b2e2eb636363 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:27.564585 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-039a0b94-c68a-4820-957b-b2e2eb636363 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:27.564691 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-884c2fee-3cc7-4358-a249-9901110c5cea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045798 Oct 27 17:39:27.565233 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 444/917] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Oct 27 17:39:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:39:27.739287 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-039a0b94-c68a-4820-957b-b2e2eb636363 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:27.747646 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-039a0b94-c68a-4820-957b-b2e2eb636363 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:27.749170 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-039a0b94-c68a-4820-957b-b2e2eb636363 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:27.750601 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-039a0b94-c68a-4820-957b-b2e2eb636363 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1744 microversion: 2.20 time: 0.202935 Oct 27 17:39:27.751186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 474/918] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:27 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1744 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:39:28.776807 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8c3d5299-cc53-4180-8e09-a2ad52d9ebc6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:28.777450 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8c3d5299-cc53-4180-8e09-a2ad52d9ebc6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:28.784764 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8c3d5299-cc53-4180-8e09-a2ad52d9ebc6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:28.785245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8c3d5299-cc53-4180-8e09-a2ad52d9ebc6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:28.785677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8c3d5299-cc53-4180-8e09-a2ad52d9ebc6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:28.786366 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8c3d5299-cc53-4180-8e09-a2ad52d9ebc6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:28.786833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8c3d5299-cc53-4180-8e09-a2ad52d9ebc6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:28.787237 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8c3d5299-cc53-4180-8e09-a2ad52d9ebc6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:29.098430 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8c3d5299-cc53-4180-8e09-a2ad52d9ebc6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:29.106613 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8c3d5299-cc53-4180-8e09-a2ad52d9ebc6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:29.108234 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8c3d5299-cc53-4180-8e09-a2ad52d9ebc6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:29.109391 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8c3d5299-cc53-4180-8e09-a2ad52d9ebc6 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1744 microversion: 2.20 time: 0.337279 Oct 27 17:39:29.109948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 445/919] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:28 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1744 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:29.667055 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-377830733", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "40b6c3a9-49a5-4aa8-abaa-a41beea7c111"}], "security_groups": [{"name": "tempest-securitygroup--1485690515"}], "key_name": "tempest-keypair-1618499157", "user_data": "}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:39:29.769866 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.network.neutron [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] validate_networks() for [('40b6c3a9-49a5-4aa8-abaa-a41beea7c111', None, None, None, None, None)] {{(pid=119047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:39:30.110744 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-fb3aa7e2-0c7a-4776-aee2-127341d5c10c req-7f1fca1d-a531-401c-975a-22ff99d6845e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef8a04a-8ed9-43bd-8a43-8ed991b5d746", "name": "network-vif-plugged", "status": "completed", "tag": "e44c2473-a49a-4e38-91e6-b32e6e8065d8"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:39:30.126425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-fb3aa7e2-0c7a-4776-aee2-127341d5c10c req-7f1fca1d-a531-401c-975a-22ff99d6845e service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:30.127144 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-fb3aa7e2-0c7a-4776-aee2-127341d5c10c req-7f1fca1d-a531-401c-975a-22ff99d6845e service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:30.127765 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-fb3aa7e2-0c7a-4776-aee2-127341d5c10c req-7f1fca1d-a531-401c-975a-22ff99d6845e service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:30.143494 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Flavor limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:39:30.144133 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Image limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:39:30.144612 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Flavor pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:39:30.145022 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Image pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:39:30.145432 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:39:30.154610 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-fb3aa7e2-0c7a-4776-aee2-127341d5c10c req-7f1fca1d-a531-401c-975a-22ff99d6845e service nova] Creating event network-vif-plugged:e44c2473-a49a-4e38-91e6-b32e6e8065d8 for instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 on hv-cinder-86283 Oct 27 17:39:30.157038 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:30.161551 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:30.162005 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:30.162763 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:30.163235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:30.163650 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:30.165701 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-fb3aa7e2-0c7a-4776-aee2-127341d5c10c req-7f1fca1d-a531-401c-975a-22ff99d6845e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059795 Oct 27 17:39:30.166614 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 446/920] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:39:30.179693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ebe342d5-de8d-4070-8c30-31ee6e8345a5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:30.180494 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ebe342d5-de8d-4070-8c30-31ee6e8345a5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:30.186620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Getting quotas for project a35c2b53ccb445d4b0dd2915376f69cf. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:39:30.187009 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ebe342d5-de8d-4070-8c30-31ee6e8345a5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:30.187497 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ebe342d5-de8d-4070-8c30-31ee6e8345a5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:30.187967 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ebe342d5-de8d-4070-8c30-31ee6e8345a5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:30.188667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ebe342d5-de8d-4070-8c30-31ee6e8345a5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:30.189118 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ebe342d5-de8d-4070-8c30-31ee6e8345a5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:30.189544 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ebe342d5-de8d-4070-8c30-31ee6e8345a5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:30.190799 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Getting quotas for user 3c36ea3a53cc48fa996891e3c6ddfda8 and project a35c2b53ccb445d4b0dd2915376f69cf. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:39:30.202392 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Going to run 1 instances... {{(pid=119047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:39:30.204733 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:39:30.273999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-fff464ca-1598-40a1-b404-54ffe1f11812 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.611202 Oct 27 17:39:30.275356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 475/921] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:39:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:39:30.287098 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c3099b77-c31d-4605-ad34-78b1abca36a9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:30.287785 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c3099b77-c31d-4605-ad34-78b1abca36a9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:30.335099 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ebe342d5-de8d-4070-8c30-31ee6e8345a5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:30.343327 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ebe342d5-de8d-4070-8c30-31ee6e8345a5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:30.344782 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ebe342d5-de8d-4070-8c30-31ee6e8345a5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:30.345937 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ebe342d5-de8d-4070-8c30-31ee6e8345a5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1744 microversion: 2.20 time: 0.178254 Oct 27 17:39:30.346627 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 447/922] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:30 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:30.349726 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c3099b77-c31d-4605-ad34-78b1abca36a9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:30.358383 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c3099b77-c31d-4605-ad34-78b1abca36a9 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 200 len: 1241 microversion: 2.1 time: 0.076529 Oct 27 17:39:30.359094 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 476/923] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:30 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:39:31.374488 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4c12128b-f449-4343-befd-58c140059352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:31.375122 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4c12128b-f449-4343-befd-58c140059352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:31.381465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-09cb98e4-53c9-4201-b8d2-5563c3f5b51a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:31.382312 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-09cb98e4-53c9-4201-b8d2-5563c3f5b51a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:31.382423 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4c12128b-f449-4343-befd-58c140059352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:31.382808 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4c12128b-f449-4343-befd-58c140059352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:31.383241 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4c12128b-f449-4343-befd-58c140059352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:31.383979 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4c12128b-f449-4343-befd-58c140059352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:31.384431 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4c12128b-f449-4343-befd-58c140059352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:31.384994 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4c12128b-f449-4343-befd-58c140059352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:31.390344 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09cb98e4-53c9-4201-b8d2-5563c3f5b51a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:31.390910 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09cb98e4-53c9-4201-b8d2-5563c3f5b51a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:31.391412 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09cb98e4-53c9-4201-b8d2-5563c3f5b51a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:31.392382 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09cb98e4-53c9-4201-b8d2-5563c3f5b51a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:31.392957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09cb98e4-53c9-4201-b8d2-5563c3f5b51a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:31.393476 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-09cb98e4-53c9-4201-b8d2-5563c3f5b51a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:31.457433 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-09cb98e4-53c9-4201-b8d2-5563c3f5b51a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:31.466032 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-09cb98e4-53c9-4201-b8d2-5563c3f5b51a tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 200 len: 1301 microversion: 2.1 time: 0.088467 Oct 27 17:39:31.466824 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 477/924] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:31 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:39:31.602093 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4c12128b-f449-4343-befd-58c140059352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:31.610567 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4c12128b-f449-4343-befd-58c140059352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:31.612051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4c12128b-f449-4343-befd-58c140059352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:31.613271 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4c12128b-f449-4343-befd-58c140059352 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1744 microversion: 2.20 time: 0.243175 Oct 27 17:39:31.613831 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 448/925] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:31 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1744 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:32.490543 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4d446f1b-8f39-4259-9857-3cd4a98224b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:32.491878 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4d446f1b-8f39-4259-9857-3cd4a98224b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:32.501589 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4d446f1b-8f39-4259-9857-3cd4a98224b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:32.502245 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4d446f1b-8f39-4259-9857-3cd4a98224b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:32.502674 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4d446f1b-8f39-4259-9857-3cd4a98224b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:32.503365 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4d446f1b-8f39-4259-9857-3cd4a98224b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:32.503838 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4d446f1b-8f39-4259-9857-3cd4a98224b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:32.504250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4d446f1b-8f39-4259-9857-3cd4a98224b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:32.509147 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:39:32.640175 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7f9e3ae9-c77a-4e91-873e-7f9df90e23a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:32.641479 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7f9e3ae9-c77a-4e91-873e-7f9df90e23a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:32.652041 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f9e3ae9-c77a-4e91-873e-7f9df90e23a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:32.652802 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f9e3ae9-c77a-4e91-873e-7f9df90e23a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:32.653417 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f9e3ae9-c77a-4e91-873e-7f9df90e23a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:32.654283 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f9e3ae9-c77a-4e91-873e-7f9df90e23a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:32.654886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f9e3ae9-c77a-4e91-873e-7f9df90e23a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:32.655493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7f9e3ae9-c77a-4e91-873e-7f9df90e23a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:32.735439 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4d446f1b-8f39-4259-9857-3cd4a98224b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:32.747219 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4d446f1b-8f39-4259-9857-3cd4a98224b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 200 len: 1367 microversion: 2.1 time: 0.260746 Oct 27 17:39:32.748549 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 478/926] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:32 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:39:32.890197 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7f9e3ae9-c77a-4e91-873e-7f9df90e23a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:32.902837 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7f9e3ae9-c77a-4e91-873e-7f9df90e23a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:32.904318 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7f9e3ae9-c77a-4e91-873e-7f9df90e23a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:32.905714 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7f9e3ae9-c77a-4e91-873e-7f9df90e23a0 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1739 microversion: 2.20 time: 0.270456 Oct 27 17:39:32.908551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 449/927] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:32 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:33.284262 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-ddd867b1-34bd-4cac-b49d-e4d75aab3e7b req-c85ae695-5130-4d4c-86e9-98ce7b5ccfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df713ea3-3864-4216-8d98-2d008ac2baab", "tag": "48cf2b20-7d7f-4936-b226-396b5f7eae33"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:39:33.300057 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-ddd867b1-34bd-4cac-b49d-e4d75aab3e7b req-c85ae695-5130-4d4c-86e9-98ce7b5ccfe8 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:33.300992 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-ddd867b1-34bd-4cac-b49d-e4d75aab3e7b req-c85ae695-5130-4d4c-86e9-98ce7b5ccfe8 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:33.301761 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-ddd867b1-34bd-4cac-b49d-e4d75aab3e7b req-c85ae695-5130-4d4c-86e9-98ce7b5ccfe8 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:33.320914 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-ddd867b1-34bd-4cac-b49d-e4d75aab3e7b req-c85ae695-5130-4d4c-86e9-98ce7b5ccfe8 service nova] Creating event network-changed:48cf2b20-7d7f-4936-b226-396b5f7eae33 for instance df713ea3-3864-4216-8d98-2d008ac2baab on hv-cinder-86283 Oct 27 17:39:33.326945 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-ddd867b1-34bd-4cac-b49d-e4d75aab3e7b req-c85ae695-5130-4d4c-86e9-98ce7b5ccfe8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048279 Oct 27 17:39:33.328171 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 479/928] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:39:33.775267 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-74b96e5b-8f0b-48d7-a7cd-3eaef634e6a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:33.776483 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-74b96e5b-8f0b-48d7-a7cd-3eaef634e6a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:33.783705 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74b96e5b-8f0b-48d7-a7cd-3eaef634e6a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:33.784440 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74b96e5b-8f0b-48d7-a7cd-3eaef634e6a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:33.785047 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74b96e5b-8f0b-48d7-a7cd-3eaef634e6a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:33.786108 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74b96e5b-8f0b-48d7-a7cd-3eaef634e6a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:33.786557 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74b96e5b-8f0b-48d7-a7cd-3eaef634e6a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:33.787117 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74b96e5b-8f0b-48d7-a7cd-3eaef634e6a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:33.934798 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-30130e58-378c-4145-9a44-a32cd8d05b49 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:33.936194 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-30130e58-378c-4145-9a44-a32cd8d05b49 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:33.947000 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-74b96e5b-8f0b-48d7-a7cd-3eaef634e6a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:33.950587 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-30130e58-378c-4145-9a44-a32cd8d05b49 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:33.955041 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-74b96e5b-8f0b-48d7-a7cd-3eaef634e6a8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 200 len: 1367 microversion: 2.1 time: 0.183640 Oct 27 17:39:33.955920 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-30130e58-378c-4145-9a44-a32cd8d05b49 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:33.956357 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-30130e58-378c-4145-9a44-a32cd8d05b49 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:33.957086 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-30130e58-378c-4145-9a44-a32cd8d05b49 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:33.957528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-30130e58-378c-4145-9a44-a32cd8d05b49 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:33.958272 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 450/929] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:33 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:39:33.958866 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-30130e58-378c-4145-9a44-a32cd8d05b49 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:34.105543 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-30130e58-378c-4145-9a44-a32cd8d05b49 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:34.115000 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-30130e58-378c-4145-9a44-a32cd8d05b49 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:34.116571 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-30130e58-378c-4145-9a44-a32cd8d05b49 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:34.117824 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-30130e58-378c-4145-9a44-a32cd8d05b49 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1739 microversion: 2.20 time: 0.187419 Oct 27 17:39:34.118397 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 480/930] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:33 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:39:34.981436 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f9630344-1510-47ac-85ee-a9f3e500f367 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:34.982657 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-f9630344-1510-47ac-85ee-a9f3e500f367 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:34.990102 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f9630344-1510-47ac-85ee-a9f3e500f367 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:34.990816 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f9630344-1510-47ac-85ee-a9f3e500f367 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:34.991450 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f9630344-1510-47ac-85ee-a9f3e500f367 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:34.992184 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f9630344-1510-47ac-85ee-a9f3e500f367 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:34.992640 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f9630344-1510-47ac-85ee-a9f3e500f367 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:34.993118 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f9630344-1510-47ac-85ee-a9f3e500f367 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:35.145957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-073e251e-fa81-43ee-b9ad-92122fb51a4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:35.146785 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-073e251e-fa81-43ee-b9ad-92122fb51a4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:35.153803 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-073e251e-fa81-43ee-b9ad-92122fb51a4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:35.154521 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-073e251e-fa81-43ee-b9ad-92122fb51a4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:35.155186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-073e251e-fa81-43ee-b9ad-92122fb51a4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:35.156083 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-073e251e-fa81-43ee-b9ad-92122fb51a4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:35.156867 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-073e251e-fa81-43ee-b9ad-92122fb51a4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:35.157455 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-073e251e-fa81-43ee-b9ad-92122fb51a4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:35.162686 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f9630344-1510-47ac-85ee-a9f3e500f367 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:35.172840 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f9630344-1510-47ac-85ee-a9f3e500f367 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 200 len: 1367 microversion: 2.1 time: 0.195387 Oct 27 17:39:35.173434 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 451/931] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:34 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:39:35.320654 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-073e251e-fa81-43ee-b9ad-92122fb51a4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:35.329776 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-073e251e-fa81-43ee-b9ad-92122fb51a4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:35.331348 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-073e251e-fa81-43ee-b9ad-92122fb51a4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:35.332786 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-073e251e-fa81-43ee-b9ad-92122fb51a4b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1739 microversion: 2.20 time: 0.190844 Oct 27 17:39:35.333735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 481/932] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:35 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:39:36.198424 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2b0356aa-29f2-45e3-9642-9cc7fe456aed tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:36.199045 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2b0356aa-29f2-45e3-9642-9cc7fe456aed tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:36.201425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:39:36.211161 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2b0356aa-29f2-45e3-9642-9cc7fe456aed tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:36.212143 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2b0356aa-29f2-45e3-9642-9cc7fe456aed tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:36.212950 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2b0356aa-29f2-45e3-9642-9cc7fe456aed tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:36.213966 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2b0356aa-29f2-45e3-9642-9cc7fe456aed tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:36.214676 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2b0356aa-29f2-45e3-9642-9cc7fe456aed tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:36.215242 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2b0356aa-29f2-45e3-9642-9cc7fe456aed tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:36.364027 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f2971191-9b4e-41de-b7fe-ee1d41c91470 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:36.364647 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f2971191-9b4e-41de-b7fe-ee1d41c91470 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:36.374885 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2971191-9b4e-41de-b7fe-ee1d41c91470 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:36.375374 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2971191-9b4e-41de-b7fe-ee1d41c91470 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:36.380509 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2971191-9b4e-41de-b7fe-ee1d41c91470 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:36.381488 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2971191-9b4e-41de-b7fe-ee1d41c91470 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:36.382256 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2971191-9b4e-41de-b7fe-ee1d41c91470 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:36.382846 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2971191-9b4e-41de-b7fe-ee1d41c91470 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:36.445362 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2b0356aa-29f2-45e3-9642-9cc7fe456aed tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:36.454402 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2b0356aa-29f2-45e3-9642-9cc7fe456aed tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 200 len: 1367 microversion: 2.1 time: 0.259762 Oct 27 17:39:36.459549 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 452/933] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:36 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:39:36.595459 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f2971191-9b4e-41de-b7fe-ee1d41c91470 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:36.605539 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f2971191-9b4e-41de-b7fe-ee1d41c91470 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:36.607637 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f2971191-9b4e-41de-b7fe-ee1d41c91470 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:36.610093 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f2971191-9b4e-41de-b7fe-ee1d41c91470 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1739 microversion: 2.20 time: 0.250402 Oct 27 17:39:36.611296 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 482/934] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:36 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:37.482520 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0b6f7740-b4af-4d04-9ce0-54f6e30fdce2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:37.483296 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-0b6f7740-b4af-4d04-9ce0-54f6e30fdce2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:37.492136 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b6f7740-b4af-4d04-9ce0-54f6e30fdce2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:37.492923 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b6f7740-b4af-4d04-9ce0-54f6e30fdce2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:37.493621 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b6f7740-b4af-4d04-9ce0-54f6e30fdce2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:37.494590 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b6f7740-b4af-4d04-9ce0-54f6e30fdce2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:37.495112 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b6f7740-b4af-4d04-9ce0-54f6e30fdce2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:37.495598 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b6f7740-b4af-4d04-9ce0-54f6e30fdce2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:37.555135 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=4 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:39:37.637313 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f956edeb-a7a7-4af5-b4aa-43242a2f5f50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:37.638523 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f956edeb-a7a7-4af5-b4aa-43242a2f5f50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:37.643325 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:39:37.647425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f956edeb-a7a7-4af5-b4aa-43242a2f5f50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:37.647947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f956edeb-a7a7-4af5-b4aa-43242a2f5f50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:37.648391 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f956edeb-a7a7-4af5-b4aa-43242a2f5f50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:37.649347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f956edeb-a7a7-4af5-b4aa-43242a2f5f50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:37.649809 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f956edeb-a7a7-4af5-b4aa-43242a2f5f50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:37.650237 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f956edeb-a7a7-4af5-b4aa-43242a2f5f50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:37.654177 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0b6f7740-b4af-4d04-9ce0-54f6e30fdce2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:37.669667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0b6f7740-b4af-4d04-9ce0-54f6e30fdce2 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 200 len: 1367 microversion: 2.1 time: 0.190945 Oct 27 17:39:37.696332 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 453/935] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:37 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:39:37.792860 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f956edeb-a7a7-4af5-b4aa-43242a2f5f50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:37.801833 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f956edeb-a7a7-4af5-b4aa-43242a2f5f50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:37.803926 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f956edeb-a7a7-4af5-b4aa-43242a2f5f50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:37.805716 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f956edeb-a7a7-4af5-b4aa-43242a2f5f50 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1739 microversion: 2.20 time: 0.172795 Oct 27 17:39:37.817202 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 483/936] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:37 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:39:38.700940 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9428168c-2c29-4b1e-8b46-20e237d31dfe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:38.701993 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9428168c-2c29-4b1e-8b46-20e237d31dfe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:38.711163 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9428168c-2c29-4b1e-8b46-20e237d31dfe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:38.711570 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9428168c-2c29-4b1e-8b46-20e237d31dfe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:38.712120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9428168c-2c29-4b1e-8b46-20e237d31dfe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:38.712725 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9428168c-2c29-4b1e-8b46-20e237d31dfe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:38.713175 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9428168c-2c29-4b1e-8b46-20e237d31dfe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:38.713663 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9428168c-2c29-4b1e-8b46-20e237d31dfe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:38.832938 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-42e432df-e901-4438-942a-fcbfa1c1663d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:38.835600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-42e432df-e901-4438-942a-fcbfa1c1663d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:38.847504 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-42e432df-e901-4438-942a-fcbfa1c1663d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:38.848711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-42e432df-e901-4438-942a-fcbfa1c1663d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:38.849834 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-42e432df-e901-4438-942a-fcbfa1c1663d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:38.851191 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-42e432df-e901-4438-942a-fcbfa1c1663d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:38.852009 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-42e432df-e901-4438-942a-fcbfa1c1663d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:38.852682 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-42e432df-e901-4438-942a-fcbfa1c1663d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:38.897049 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9428168c-2c29-4b1e-8b46-20e237d31dfe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:38.905890 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9428168c-2c29-4b1e-8b46-20e237d31dfe tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 200 len: 1367 microversion: 2.1 time: 0.208678 Oct 27 17:39:38.907169 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 454/937] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:38 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:39:39.015745 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-42e432df-e901-4438-942a-fcbfa1c1663d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:39.025560 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-42e432df-e901-4438-942a-fcbfa1c1663d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:39.027017 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-42e432df-e901-4438-942a-fcbfa1c1663d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:39.028222 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-42e432df-e901-4438-942a-fcbfa1c1663d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1739 microversion: 2.20 time: 0.199616 Oct 27 17:39:39.030623 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 484/938] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:38 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:39.934344 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-59158092-0ce7-4ad8-9ab1-2d4d4d0555b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:39.934876 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-59158092-0ce7-4ad8-9ab1-2d4d4d0555b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:39.943038 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-59158092-0ce7-4ad8-9ab1-2d4d4d0555b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:39.944924 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-59158092-0ce7-4ad8-9ab1-2d4d4d0555b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:39.946087 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-59158092-0ce7-4ad8-9ab1-2d4d4d0555b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:39.947313 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-59158092-0ce7-4ad8-9ab1-2d4d4d0555b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:39.948244 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-59158092-0ce7-4ad8-9ab1-2d4d4d0555b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:39.949450 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-59158092-0ce7-4ad8-9ab1-2d4d4d0555b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:40.055903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1a23c93e-f0f6-4830-9e04-9ddca6c580c1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:40.057356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-1a23c93e-f0f6-4830-9e04-9ddca6c580c1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:40.066898 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1a23c93e-f0f6-4830-9e04-9ddca6c580c1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:40.072283 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1a23c93e-f0f6-4830-9e04-9ddca6c580c1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:40.073162 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1a23c93e-f0f6-4830-9e04-9ddca6c580c1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:40.074145 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1a23c93e-f0f6-4830-9e04-9ddca6c580c1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:40.074842 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1a23c93e-f0f6-4830-9e04-9ddca6c580c1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:40.075491 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1a23c93e-f0f6-4830-9e04-9ddca6c580c1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:40.161607 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-59158092-0ce7-4ad8-9ab1-2d4d4d0555b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:40.176531 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:39:40.180325 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-59158092-0ce7-4ad8-9ab1-2d4d4d0555b1 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 200 len: 1367 microversion: 2.1 time: 0.250471 Oct 27 17:39:40.193517 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 455/939] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:39 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:39:40.293070 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1a23c93e-f0f6-4830-9e04-9ddca6c580c1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:40.302653 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1a23c93e-f0f6-4830-9e04-9ddca6c580c1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:40.304789 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1a23c93e-f0f6-4830-9e04-9ddca6c580c1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:40.306413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1a23c93e-f0f6-4830-9e04-9ddca6c580c1 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1739 microversion: 2.20 time: 0.254421 Oct 27 17:39:40.320321 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 485/940] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:40 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1739 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:39:40.462033 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-f96e2020-9524-451e-a612-e75f2e17a2e7 req-df1b9499-ddde-436d-8422-fc3e1ee576cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df713ea3-3864-4216-8d98-2d008ac2baab", "name": "network-vif-plugged", "status": "completed", "tag": "48cf2b20-7d7f-4936-b226-396b5f7eae33"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:39:40.476837 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-f96e2020-9524-451e-a612-e75f2e17a2e7 req-df1b9499-ddde-436d-8422-fc3e1ee576cf service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:40.477989 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-f96e2020-9524-451e-a612-e75f2e17a2e7 req-df1b9499-ddde-436d-8422-fc3e1ee576cf service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:40.477989 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-f96e2020-9524-451e-a612-e75f2e17a2e7 req-df1b9499-ddde-436d-8422-fc3e1ee576cf service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:40.494350 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-f96e2020-9524-451e-a612-e75f2e17a2e7 req-df1b9499-ddde-436d-8422-fc3e1ee576cf service nova] Creating event network-vif-plugged:48cf2b20-7d7f-4936-b226-396b5f7eae33 for instance df713ea3-3864-4216-8d98-2d008ac2baab on hv-cinder-86283 Oct 27 17:39:40.500595 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-f96e2020-9524-451e-a612-e75f2e17a2e7 req-df1b9499-ddde-436d-8422-fc3e1ee576cf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042587 Oct 27 17:39:40.501488 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 456/941] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:39:41.210577 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-97948d79-79f7-4673-a9f6-9263882e1c46 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:41.211940 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-97948d79-79f7-4673-a9f6-9263882e1c46 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:41.214153 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=8 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:39:41.220828 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97948d79-79f7-4673-a9f6-9263882e1c46 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:41.221326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97948d79-79f7-4673-a9f6-9263882e1c46 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:41.221770 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97948d79-79f7-4673-a9f6-9263882e1c46 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:41.222769 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97948d79-79f7-4673-a9f6-9263882e1c46 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:41.223226 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97948d79-79f7-4673-a9f6-9263882e1c46 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:41.223661 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97948d79-79f7-4673-a9f6-9263882e1c46 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:41.338728 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0dbed309-c0f9-4262-a039-84d2adc5592a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:41.339603 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-0dbed309-c0f9-4262-a039-84d2adc5592a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:41.347990 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0dbed309-c0f9-4262-a039-84d2adc5592a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:41.348605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0dbed309-c0f9-4262-a039-84d2adc5592a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:41.349120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0dbed309-c0f9-4262-a039-84d2adc5592a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:41.350062 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0dbed309-c0f9-4262-a039-84d2adc5592a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:41.350777 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0dbed309-c0f9-4262-a039-84d2adc5592a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:41.351280 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0dbed309-c0f9-4262-a039-84d2adc5592a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:41.394166 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-97948d79-79f7-4673-a9f6-9263882e1c46 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:41.402096 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-97948d79-79f7-4673-a9f6-9263882e1c46 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 200 len: 1367 microversion: 2.1 time: 0.195533 Oct 27 17:39:41.403195 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 486/942] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:41 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:39:41.499765 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0dbed309-c0f9-4262-a039-84d2adc5592a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:41.508571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0dbed309-c0f9-4262-a039-84d2adc5592a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:41.510383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0dbed309-c0f9-4262-a039-84d2adc5592a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:41.511783 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0dbed309-c0f9-4262-a039-84d2adc5592a tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1739 microversion: 2.20 time: 0.179641 Oct 27 17:39:41.523755 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 457/943] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:41 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:39:42.426477 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-571eecf9-06eb-4f0d-b7d1-8a7c5c90ea83 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:42.427012 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-571eecf9-06eb-4f0d-b7d1-8a7c5c90ea83 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:42.433488 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-571eecf9-06eb-4f0d-b7d1-8a7c5c90ea83 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:42.433966 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-571eecf9-06eb-4f0d-b7d1-8a7c5c90ea83 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:42.434396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-571eecf9-06eb-4f0d-b7d1-8a7c5c90ea83 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:42.435073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-571eecf9-06eb-4f0d-b7d1-8a7c5c90ea83 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:42.435520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-571eecf9-06eb-4f0d-b7d1-8a7c5c90ea83 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:42.436574 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-571eecf9-06eb-4f0d-b7d1-8a7c5c90ea83 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:42.537644 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-44a33330-e6ba-4f6d-a129-0ff2a1f25514 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:42.538400 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-44a33330-e6ba-4f6d-a129-0ff2a1f25514 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:42.544732 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44a33330-e6ba-4f6d-a129-0ff2a1f25514 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:42.545724 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44a33330-e6ba-4f6d-a129-0ff2a1f25514 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:42.546194 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44a33330-e6ba-4f6d-a129-0ff2a1f25514 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:42.547105 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44a33330-e6ba-4f6d-a129-0ff2a1f25514 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:42.547434 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44a33330-e6ba-4f6d-a129-0ff2a1f25514 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:42.547890 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44a33330-e6ba-4f6d-a129-0ff2a1f25514 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:42.567547 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-571eecf9-06eb-4f0d-b7d1-8a7c5c90ea83 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:42.575436 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-571eecf9-06eb-4f0d-b7d1-8a7c5c90ea83 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 200 len: 1367 microversion: 2.1 time: 0.152763 Oct 27 17:39:42.576269 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 487/944] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:42 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:39:42.676364 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-44a33330-e6ba-4f6d-a129-0ff2a1f25514 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:42.684529 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-44a33330-e6ba-4f6d-a129-0ff2a1f25514 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:42.686567 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-44a33330-e6ba-4f6d-a129-0ff2a1f25514 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:42.687779 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-44a33330-e6ba-4f6d-a129-0ff2a1f25514 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1739 microversion: 2.20 time: 0.154113 Oct 27 17:39:42.688350 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 458/945] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:42 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:39:43.598676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b7158eb0-77e8-4c93-bf75-680739ae23d8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:43.599383 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b7158eb0-77e8-4c93-bf75-680739ae23d8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:43.605878 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b7158eb0-77e8-4c93-bf75-680739ae23d8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:43.606465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b7158eb0-77e8-4c93-bf75-680739ae23d8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:43.606909 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b7158eb0-77e8-4c93-bf75-680739ae23d8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:43.607611 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b7158eb0-77e8-4c93-bf75-680739ae23d8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:43.608093 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b7158eb0-77e8-4c93-bf75-680739ae23d8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:43.608523 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b7158eb0-77e8-4c93-bf75-680739ae23d8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:43.713429 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-fa357231-4080-4d52-b20b-ace6a3d07368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:43.714044 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-fa357231-4080-4d52-b20b-ace6a3d07368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:43.720628 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fa357231-4080-4d52-b20b-ace6a3d07368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:43.721108 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fa357231-4080-4d52-b20b-ace6a3d07368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:43.721541 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fa357231-4080-4d52-b20b-ace6a3d07368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:43.722487 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fa357231-4080-4d52-b20b-ace6a3d07368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:43.722936 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fa357231-4080-4d52-b20b-ace6a3d07368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:43.723356 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fa357231-4080-4d52-b20b-ace6a3d07368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:43.742900 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-b7158eb0-77e8-4c93-bf75-680739ae23d8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:43.752017 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b7158eb0-77e8-4c93-bf75-680739ae23d8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 200 len: 1558 microversion: 2.1 time: 0.157430 Oct 27 17:39:43.752813 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 488/946] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:39:43 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:39:43.774760 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c05b7573-dfb2-4451-960d-085587ea0d6d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:43.775273 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c05b7573-dfb2-4451-960d-085587ea0d6d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:43.782111 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c05b7573-dfb2-4451-960d-085587ea0d6d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:43.782789 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c05b7573-dfb2-4451-960d-085587ea0d6d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:43.783233 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c05b7573-dfb2-4451-960d-085587ea0d6d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:43.784817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c05b7573-dfb2-4451-960d-085587ea0d6d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:43.784817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c05b7573-dfb2-4451-960d-085587ea0d6d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:43.785041 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c05b7573-dfb2-4451-960d-085587ea0d6d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:43.863495 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c05b7573-dfb2-4451-960d-085587ea0d6d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092527 Oct 27 17:39:43.864130 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 489/947] 10.222.0.36 () {58 vars in 1275 bytes} [Thu Oct 27 17:39:43 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:39:43.915033 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-fa357231-4080-4d52-b20b-ace6a3d07368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:43.923964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-fa357231-4080-4d52-b20b-ace6a3d07368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:43.925507 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-fa357231-4080-4d52-b20b-ace6a3d07368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:43.926666 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-fa357231-4080-4d52-b20b-ace6a3d07368 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1721 microversion: 2.20 time: 0.217672 Oct 27 17:39:43.927259 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 459/948] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:43 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 17:39:44.955260 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-231fe087-2b1b-43fb-98fc-eac4c98e78fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:44.955920 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-231fe087-2b1b-43fb-98fc-eac4c98e78fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:44.963016 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-231fe087-2b1b-43fb-98fc-eac4c98e78fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:44.963795 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-231fe087-2b1b-43fb-98fc-eac4c98e78fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:44.964647 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-231fe087-2b1b-43fb-98fc-eac4c98e78fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:44.965766 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-231fe087-2b1b-43fb-98fc-eac4c98e78fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:44.966290 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-231fe087-2b1b-43fb-98fc-eac4c98e78fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:44.966889 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-231fe087-2b1b-43fb-98fc-eac4c98e78fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:44.984130 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-eee2b0ae-395b-48aa-b325-09473405fa0e req-1b69a864-244a-486f-9848-370e8c319fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df713ea3-3864-4216-8d98-2d008ac2baab", "tag": "48cf2b20-7d7f-4936-b226-396b5f7eae33"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:39:44.993874 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-eee2b0ae-395b-48aa-b325-09473405fa0e req-1b69a864-244a-486f-9848-370e8c319fef service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:44.994562 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-eee2b0ae-395b-48aa-b325-09473405fa0e req-1b69a864-244a-486f-9848-370e8c319fef service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:44.995156 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-eee2b0ae-395b-48aa-b325-09473405fa0e req-1b69a864-244a-486f-9848-370e8c319fef service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:45.009449 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-eee2b0ae-395b-48aa-b325-09473405fa0e req-1b69a864-244a-486f-9848-370e8c319fef service nova] Creating event network-changed:48cf2b20-7d7f-4936-b226-396b5f7eae33 for instance df713ea3-3864-4216-8d98-2d008ac2baab on hv-cinder-86283 Oct 27 17:39:45.014295 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-eee2b0ae-395b-48aa-b325-09473405fa0e req-1b69a864-244a-486f-9848-370e8c319fef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034250 Oct 27 17:39:45.015091 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 460/949] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:39:45.116185 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-231fe087-2b1b-43fb-98fc-eac4c98e78fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:45.124817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-231fe087-2b1b-43fb-98fc-eac4c98e78fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:45.126276 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-231fe087-2b1b-43fb-98fc-eac4c98e78fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:45.127537 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-231fe087-2b1b-43fb-98fc-eac4c98e78fc tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1721 microversion: 2.20 time: 0.177070 Oct 27 17:39:45.128370 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 490/950] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:44 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:46.155688 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-f3eb0335-2aa9-4b79-8677-e7195084193b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:46.156587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-f3eb0335-2aa9-4b79-8677-e7195084193b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:46.170928 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f3eb0335-2aa9-4b79-8677-e7195084193b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:46.171428 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f3eb0335-2aa9-4b79-8677-e7195084193b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:46.171892 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f3eb0335-2aa9-4b79-8677-e7195084193b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:46.172602 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f3eb0335-2aa9-4b79-8677-e7195084193b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:46.173240 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f3eb0335-2aa9-4b79-8677-e7195084193b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:46.173659 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-f3eb0335-2aa9-4b79-8677-e7195084193b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:46.194590 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-e7b29637-f1c7-4df6-80cd-4ff40731093d req-9d826cbd-0586-4bca-ab86-66b2dcbcb733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef8a04a-8ed9-43bd-8a43-8ed991b5d746", "name": "network-vif-unplugged", "status": "completed", "tag": "e44c2473-a49a-4e38-91e6-b32e6e8065d8"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:39:46.209563 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-e7b29637-f1c7-4df6-80cd-4ff40731093d req-9d826cbd-0586-4bca-ab86-66b2dcbcb733 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:46.210385 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-e7b29637-f1c7-4df6-80cd-4ff40731093d req-9d826cbd-0586-4bca-ab86-66b2dcbcb733 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:46.211026 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-e7b29637-f1c7-4df6-80cd-4ff40731093d req-9d826cbd-0586-4bca-ab86-66b2dcbcb733 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:46.231334 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-e7b29637-f1c7-4df6-80cd-4ff40731093d req-9d826cbd-0586-4bca-ab86-66b2dcbcb733 service nova] Creating event network-vif-unplugged:e44c2473-a49a-4e38-91e6-b32e6e8065d8 for instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 on hv-cinder-86283 Oct 27 17:39:46.237857 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-e7b29637-f1c7-4df6-80cd-4ff40731093d req-9d826cbd-0586-4bca-ab86-66b2dcbcb733 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047540 Oct 27 17:39:46.238802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 491/951] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:39:46.427050 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f3eb0335-2aa9-4b79-8677-e7195084193b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:46.435191 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f3eb0335-2aa9-4b79-8677-e7195084193b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:46.437327 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-f3eb0335-2aa9-4b79-8677-e7195084193b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:46.438500 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-f3eb0335-2aa9-4b79-8677-e7195084193b tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1724 microversion: 2.20 time: 0.289545 Oct 27 17:39:46.439057 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 461/952] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:46 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:46.464194 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5deea02b-b21d-4119-a493-9665e16db397 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e48340da-a898-480d-a498-d3cf0f06a6dc"}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:39:46.466675 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-5deea02b-b21d-4119-a493-9665e16db397 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:46.473404 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5deea02b-b21d-4119-a493-9665e16db397 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:46.473891 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5deea02b-b21d-4119-a493-9665e16db397 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:46.474328 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5deea02b-b21d-4119-a493-9665e16db397 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:46.475041 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5deea02b-b21d-4119-a493-9665e16db397 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:46.475496 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5deea02b-b21d-4119-a493-9665e16db397 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:46.475954 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5deea02b-b21d-4119-a493-9665e16db397 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:46.777651 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5deea02b-b21d-4119-a493-9665e16db397 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "POST /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.318083 Oct 27 17:39:46.778262 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 492/953] 10.222.0.36 () {62 vars in 1364 bytes} [Thu Oct 27 17:39:46 2022] POST /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746/os-volume_attachments => generated 188 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 17:39:46.908699 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2374bb06-53de-42dc-b158-038871432d88 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:46.909283 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2374bb06-53de-42dc-b158-038871432d88 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:46.915209 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2374bb06-53de-42dc-b158-038871432d88 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:46.915696 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2374bb06-53de-42dc-b158-038871432d88 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:46.916156 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2374bb06-53de-42dc-b158-038871432d88 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:46.916835 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2374bb06-53de-42dc-b158-038871432d88 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:46.917283 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2374bb06-53de-42dc-b158-038871432d88 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:46.917703 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2374bb06-53de-42dc-b158-038871432d88 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:47.000943 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=100 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:39:47.169877 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2374bb06-53de-42dc-b158-038871432d88 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746/os-volume_attachments/e48340da-a898-480d-a498-d3cf0f06a6dc" status: 202 len: 0 microversion: 2.20 time: 0.265773 Oct 27 17:39:47.170540 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 462/954] 10.222.0.36 () {60 vars in 1457 bytes} [Thu Oct 27 17:39:46 2022] DELETE /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746/os-volume_attachments/e48340da-a898-480d-a498-d3cf0f06a6dc => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:39:47.230565 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4539876d-339a-44fe-8fc2-54b982249a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:39:47.231155 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4539876d-339a-44fe-8fc2-54b982249a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:47.237542 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4539876d-339a-44fe-8fc2-54b982249a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:47.238025 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4539876d-339a-44fe-8fc2-54b982249a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:47.238456 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4539876d-339a-44fe-8fc2-54b982249a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:47.239144 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4539876d-339a-44fe-8fc2-54b982249a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:47.239592 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4539876d-339a-44fe-8fc2-54b982249a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:47.240042 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4539876d-339a-44fe-8fc2-54b982249a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:47.270441 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4539876d-339a-44fe-8fc2-54b982249a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119047) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 17:39:47.292143 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:39:47.335182 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4539876d-339a-44fe-8fc2-54b982249a6d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "POST /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746/action" status: 202 len: 0 microversion: 2.20 time: 0.108592 Oct 27 17:39:47.335797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 493/955] 10.222.0.36 () {62 vars in 1319 bytes} [Thu Oct 27 17:39:47 2022] POST /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:39:47.344037 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e58cf34a-8359-46c7-b202-2dabe01e7ae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:47.344652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e58cf34a-8359-46c7-b202-2dabe01e7ae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:47.351470 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e58cf34a-8359-46c7-b202-2dabe01e7ae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:47.352183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e58cf34a-8359-46c7-b202-2dabe01e7ae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:47.352470 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e58cf34a-8359-46c7-b202-2dabe01e7ae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:47.353359 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e58cf34a-8359-46c7-b202-2dabe01e7ae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:47.353830 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e58cf34a-8359-46c7-b202-2dabe01e7ae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:47.354219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e58cf34a-8359-46c7-b202-2dabe01e7ae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:47.517299 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e58cf34a-8359-46c7-b202-2dabe01e7ae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:47.525645 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e58cf34a-8359-46c7-b202-2dabe01e7ae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:47.527074 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e58cf34a-8359-46c7-b202-2dabe01e7ae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:47.528248 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e58cf34a-8359-46c7-b202-2dabe01e7ae4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1672 microversion: 2.20 time: 0.188309 Oct 27 17:39:47.528805 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 463/956] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:47 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1672 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:48.554430 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-74e8dc5b-2771-4932-adf7-53686e4d45c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:48.555622 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-74e8dc5b-2771-4932-adf7-53686e4d45c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:48.562313 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74e8dc5b-2771-4932-adf7-53686e4d45c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:48.562791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74e8dc5b-2771-4932-adf7-53686e4d45c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:48.563225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74e8dc5b-2771-4932-adf7-53686e4d45c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:48.563952 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74e8dc5b-2771-4932-adf7-53686e4d45c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:48.564444 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74e8dc5b-2771-4932-adf7-53686e4d45c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:48.564859 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-74e8dc5b-2771-4932-adf7-53686e4d45c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:48.693468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-74e8dc5b-2771-4932-adf7-53686e4d45c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:48.701601 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-74e8dc5b-2771-4932-adf7-53686e4d45c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:48.703633 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-74e8dc5b-2771-4932-adf7-53686e4d45c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:48.704840 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-74e8dc5b-2771-4932-adf7-53686e4d45c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.154748 Oct 27 17:39:48.705395 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 494/957] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:48 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:49.730615 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-eab9eae2-7240-4d46-9bc7-58c16fdd0e2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:49.731341 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-eab9eae2-7240-4d46-9bc7-58c16fdd0e2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:49.738766 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eab9eae2-7240-4d46-9bc7-58c16fdd0e2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:49.739337 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eab9eae2-7240-4d46-9bc7-58c16fdd0e2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:49.739866 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eab9eae2-7240-4d46-9bc7-58c16fdd0e2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:49.740799 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eab9eae2-7240-4d46-9bc7-58c16fdd0e2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:49.741321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eab9eae2-7240-4d46-9bc7-58c16fdd0e2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:49.741805 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eab9eae2-7240-4d46-9bc7-58c16fdd0e2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:49.898971 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-eab9eae2-7240-4d46-9bc7-58c16fdd0e2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:49.907727 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-eab9eae2-7240-4d46-9bc7-58c16fdd0e2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:49.909159 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-eab9eae2-7240-4d46-9bc7-58c16fdd0e2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:49.910307 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-eab9eae2-7240-4d46-9bc7-58c16fdd0e2f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.183567 Oct 27 17:39:49.910864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 464/958] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:49 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:50.935121 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-eea506a2-f1d5-4b96-a04f-09a3e9522572 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:50.935883 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-eea506a2-f1d5-4b96-a04f-09a3e9522572 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:50.942710 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eea506a2-f1d5-4b96-a04f-09a3e9522572 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:50.943193 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eea506a2-f1d5-4b96-a04f-09a3e9522572 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:50.943633 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eea506a2-f1d5-4b96-a04f-09a3e9522572 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:50.944361 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eea506a2-f1d5-4b96-a04f-09a3e9522572 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:50.944815 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eea506a2-f1d5-4b96-a04f-09a3e9522572 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:50.945239 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-eea506a2-f1d5-4b96-a04f-09a3e9522572 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:51.080517 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-eea506a2-f1d5-4b96-a04f-09a3e9522572 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:51.088753 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-eea506a2-f1d5-4b96-a04f-09a3e9522572 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:51.090272 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-eea506a2-f1d5-4b96-a04f-09a3e9522572 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:51.091627 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-eea506a2-f1d5-4b96-a04f-09a3e9522572 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.160591 Oct 27 17:39:51.096151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 495/959] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:50 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:52.118435 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-aabdd86d-472c-4e02-bceb-2f9833413db5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:52.119041 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-aabdd86d-472c-4e02-bceb-2f9833413db5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:52.126097 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aabdd86d-472c-4e02-bceb-2f9833413db5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:52.126574 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aabdd86d-472c-4e02-bceb-2f9833413db5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:52.127008 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aabdd86d-472c-4e02-bceb-2f9833413db5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:52.127694 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aabdd86d-472c-4e02-bceb-2f9833413db5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:52.128169 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aabdd86d-472c-4e02-bceb-2f9833413db5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:52.128592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-aabdd86d-472c-4e02-bceb-2f9833413db5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:52.269024 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-aabdd86d-472c-4e02-bceb-2f9833413db5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:52.278085 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-aabdd86d-472c-4e02-bceb-2f9833413db5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:52.279533 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-aabdd86d-472c-4e02-bceb-2f9833413db5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:52.280792 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-aabdd86d-472c-4e02-bceb-2f9833413db5 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.166256 Oct 27 17:39:52.281358 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 465/960] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:52 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:53.306581 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4b20b3a5-93f0-4bb4-a102-1c84a53024c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:53.307248 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4b20b3a5-93f0-4bb4-a102-1c84a53024c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:53.314289 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4b20b3a5-93f0-4bb4-a102-1c84a53024c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:53.314774 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4b20b3a5-93f0-4bb4-a102-1c84a53024c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:53.315211 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4b20b3a5-93f0-4bb4-a102-1c84a53024c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:53.315973 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4b20b3a5-93f0-4bb4-a102-1c84a53024c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:53.316429 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4b20b3a5-93f0-4bb4-a102-1c84a53024c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:53.316860 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4b20b3a5-93f0-4bb4-a102-1c84a53024c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:53.448785 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4b20b3a5-93f0-4bb4-a102-1c84a53024c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:53.457627 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4b20b3a5-93f0-4bb4-a102-1c84a53024c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:53.459057 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4b20b3a5-93f0-4bb4-a102-1c84a53024c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:53.460277 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4b20b3a5-93f0-4bb4-a102-1c84a53024c4 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.157657 Oct 27 17:39:53.460922 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 496/961] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:53 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:54.485728 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8b727756-c3ff-4ddb-b300-b3ac6cfacf21 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:54.486328 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8b727756-c3ff-4ddb-b300-b3ac6cfacf21 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:54.492743 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b727756-c3ff-4ddb-b300-b3ac6cfacf21 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:54.493211 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b727756-c3ff-4ddb-b300-b3ac6cfacf21 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:54.493639 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b727756-c3ff-4ddb-b300-b3ac6cfacf21 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:54.494315 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b727756-c3ff-4ddb-b300-b3ac6cfacf21 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:54.494785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b727756-c3ff-4ddb-b300-b3ac6cfacf21 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:54.495203 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8b727756-c3ff-4ddb-b300-b3ac6cfacf21 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:54.644197 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8b727756-c3ff-4ddb-b300-b3ac6cfacf21 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:54.652229 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8b727756-c3ff-4ddb-b300-b3ac6cfacf21 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:54.653704 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8b727756-c3ff-4ddb-b300-b3ac6cfacf21 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:54.654857 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8b727756-c3ff-4ddb-b300-b3ac6cfacf21 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.173180 Oct 27 17:39:54.655412 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 466/962] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:54 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:55.680621 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-095cf1e2-3e2b-4d9a-8b67-4de4a98a5094 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:55.681230 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-095cf1e2-3e2b-4d9a-8b67-4de4a98a5094 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:55.687659 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-095cf1e2-3e2b-4d9a-8b67-4de4a98a5094 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:55.688162 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-095cf1e2-3e2b-4d9a-8b67-4de4a98a5094 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:55.688588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-095cf1e2-3e2b-4d9a-8b67-4de4a98a5094 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:55.689275 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-095cf1e2-3e2b-4d9a-8b67-4de4a98a5094 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:55.689730 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-095cf1e2-3e2b-4d9a-8b67-4de4a98a5094 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:55.690147 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-095cf1e2-3e2b-4d9a-8b67-4de4a98a5094 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:55.826799 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-095cf1e2-3e2b-4d9a-8b67-4de4a98a5094 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:55.835579 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-095cf1e2-3e2b-4d9a-8b67-4de4a98a5094 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:55.837031 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-095cf1e2-3e2b-4d9a-8b67-4de4a98a5094 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:55.838205 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-095cf1e2-3e2b-4d9a-8b67-4de4a98a5094 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.161582 Oct 27 17:39:55.838967 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 497/963] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:55 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:56.865665 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-5f785322-e47d-4c89-911a-867901ee3e66 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:56.866342 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-5f785322-e47d-4c89-911a-867901ee3e66 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:56.873922 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5f785322-e47d-4c89-911a-867901ee3e66 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:56.874952 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5f785322-e47d-4c89-911a-867901ee3e66 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:56.875785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5f785322-e47d-4c89-911a-867901ee3e66 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:56.876508 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5f785322-e47d-4c89-911a-867901ee3e66 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:56.877059 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5f785322-e47d-4c89-911a-867901ee3e66 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:56.877562 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5f785322-e47d-4c89-911a-867901ee3e66 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:57.198686 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5f785322-e47d-4c89-911a-867901ee3e66 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:57.207719 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5f785322-e47d-4c89-911a-867901ee3e66 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:57.209739 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5f785322-e47d-4c89-911a-867901ee3e66 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:57.210933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-5f785322-e47d-4c89-911a-867901ee3e66 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.349982 Oct 27 17:39:57.211727 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 467/964] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:56 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:58.238980 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-be3e470c-6028-4912-8dcb-0e3dec0ec7e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:58.240258 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-be3e470c-6028-4912-8dcb-0e3dec0ec7e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:58.246940 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-be3e470c-6028-4912-8dcb-0e3dec0ec7e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:58.247429 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-be3e470c-6028-4912-8dcb-0e3dec0ec7e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:58.247891 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-be3e470c-6028-4912-8dcb-0e3dec0ec7e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:58.248592 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-be3e470c-6028-4912-8dcb-0e3dec0ec7e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:58.249042 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-be3e470c-6028-4912-8dcb-0e3dec0ec7e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:58.250043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-be3e470c-6028-4912-8dcb-0e3dec0ec7e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:58.387286 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-be3e470c-6028-4912-8dcb-0e3dec0ec7e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:58.395961 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-be3e470c-6028-4912-8dcb-0e3dec0ec7e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:58.397595 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-be3e470c-6028-4912-8dcb-0e3dec0ec7e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:58.398951 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-be3e470c-6028-4912-8dcb-0e3dec0ec7e9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.163858 Oct 27 17:39:58.407951 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 498/965] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:58 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:39:59.425633 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b47dee27-1cf5-4ac2-a06e-f03772aca12d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:39:59.426280 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b47dee27-1cf5-4ac2-a06e-f03772aca12d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:39:59.432697 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b47dee27-1cf5-4ac2-a06e-f03772aca12d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:59.433177 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b47dee27-1cf5-4ac2-a06e-f03772aca12d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:59.433611 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b47dee27-1cf5-4ac2-a06e-f03772aca12d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:59.434349 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b47dee27-1cf5-4ac2-a06e-f03772aca12d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:39:59.434827 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b47dee27-1cf5-4ac2-a06e-f03772aca12d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:39:59.435232 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b47dee27-1cf5-4ac2-a06e-f03772aca12d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:39:59.574448 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b47dee27-1cf5-4ac2-a06e-f03772aca12d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:59.583371 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b47dee27-1cf5-4ac2-a06e-f03772aca12d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:59.584846 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b47dee27-1cf5-4ac2-a06e-f03772aca12d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:39:59.586000 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b47dee27-1cf5-4ac2-a06e-f03772aca12d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.164979 Oct 27 17:39:59.586545 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 468/966] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:39:59 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:40:00.612423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-23b5cedb-d7c8-4544-9f55-8b7b8d8d0a14 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:00.613024 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-23b5cedb-d7c8-4544-9f55-8b7b8d8d0a14 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:00.619404 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-23b5cedb-d7c8-4544-9f55-8b7b8d8d0a14 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:00.619911 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-23b5cedb-d7c8-4544-9f55-8b7b8d8d0a14 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:00.620371 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-23b5cedb-d7c8-4544-9f55-8b7b8d8d0a14 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:00.621048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-23b5cedb-d7c8-4544-9f55-8b7b8d8d0a14 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:00.621493 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-23b5cedb-d7c8-4544-9f55-8b7b8d8d0a14 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:00.621910 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-23b5cedb-d7c8-4544-9f55-8b7b8d8d0a14 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:00.746576 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-23b5cedb-d7c8-4544-9f55-8b7b8d8d0a14 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:00.754571 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-23b5cedb-d7c8-4544-9f55-8b7b8d8d0a14 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:00.756027 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-23b5cedb-d7c8-4544-9f55-8b7b8d8d0a14 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:00.757172 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-23b5cedb-d7c8-4544-9f55-8b7b8d8d0a14 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.149199 Oct 27 17:40:00.757723 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 499/967] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:40:00 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:40:01.782258 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-78163a94-790b-40a3-8bee-5c2520dadfa9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:01.782859 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-78163a94-790b-40a3-8bee-5c2520dadfa9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:01.789326 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-78163a94-790b-40a3-8bee-5c2520dadfa9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:01.789799 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-78163a94-790b-40a3-8bee-5c2520dadfa9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:01.790228 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-78163a94-790b-40a3-8bee-5c2520dadfa9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:01.790905 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-78163a94-790b-40a3-8bee-5c2520dadfa9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:01.791350 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-78163a94-790b-40a3-8bee-5c2520dadfa9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:01.791785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-78163a94-790b-40a3-8bee-5c2520dadfa9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:01.917338 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-78163a94-790b-40a3-8bee-5c2520dadfa9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:01.925995 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-78163a94-790b-40a3-8bee-5c2520dadfa9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:01.927435 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-78163a94-790b-40a3-8bee-5c2520dadfa9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:01.928605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-78163a94-790b-40a3-8bee-5c2520dadfa9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.150266 Oct 27 17:40:01.929152 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 469/968] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:40:01 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:40:02.953737 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-45f8807a-b82e-4794-ba88-f82c3b1a921c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:02.954342 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-45f8807a-b82e-4794-ba88-f82c3b1a921c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:02.960771 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-45f8807a-b82e-4794-ba88-f82c3b1a921c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:02.961250 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-45f8807a-b82e-4794-ba88-f82c3b1a921c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:02.961678 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-45f8807a-b82e-4794-ba88-f82c3b1a921c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:02.962358 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-45f8807a-b82e-4794-ba88-f82c3b1a921c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:02.962802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-45f8807a-b82e-4794-ba88-f82c3b1a921c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:02.963219 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-45f8807a-b82e-4794-ba88-f82c3b1a921c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:03.096134 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-45f8807a-b82e-4794-ba88-f82c3b1a921c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:03.104436 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-45f8807a-b82e-4794-ba88-f82c3b1a921c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:03.105878 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-45f8807a-b82e-4794-ba88-f82c3b1a921c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:03.107029 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-45f8807a-b82e-4794-ba88-f82c3b1a921c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.157231 Oct 27 17:40:03.107580 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 500/969] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:40:02 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:40:04.132252 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-75586c3d-fb3b-4c37-956a-c1cfbf709582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:04.132900 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-75586c3d-fb3b-4c37-956a-c1cfbf709582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:04.139290 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-75586c3d-fb3b-4c37-956a-c1cfbf709582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:04.139793 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-75586c3d-fb3b-4c37-956a-c1cfbf709582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:04.140222 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-75586c3d-fb3b-4c37-956a-c1cfbf709582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:04.140896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-75586c3d-fb3b-4c37-956a-c1cfbf709582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:04.141341 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-75586c3d-fb3b-4c37-956a-c1cfbf709582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:04.141756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-75586c3d-fb3b-4c37-956a-c1cfbf709582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:04.270301 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-75586c3d-fb3b-4c37-956a-c1cfbf709582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:04.278262 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-75586c3d-fb3b-4c37-956a-c1cfbf709582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:04.279690 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-75586c3d-fb3b-4c37-956a-c1cfbf709582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:04.280860 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-75586c3d-fb3b-4c37-956a-c1cfbf709582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.152520 Oct 27 17:40:04.281402 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 470/970] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:40:04 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:40:05.306283 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-9c8d03e9-e826-44e3-8e55-6766f21fc582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:05.306888 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-9c8d03e9-e826-44e3-8e55-6766f21fc582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:05.314041 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9c8d03e9-e826-44e3-8e55-6766f21fc582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:05.314547 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9c8d03e9-e826-44e3-8e55-6766f21fc582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:05.314983 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9c8d03e9-e826-44e3-8e55-6766f21fc582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:05.315797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9c8d03e9-e826-44e3-8e55-6766f21fc582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:05.316193 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9c8d03e9-e826-44e3-8e55-6766f21fc582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:05.316613 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9c8d03e9-e826-44e3-8e55-6766f21fc582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:05.445374 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9c8d03e9-e826-44e3-8e55-6766f21fc582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:05.454042 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9c8d03e9-e826-44e3-8e55-6766f21fc582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:05.455475 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9c8d03e9-e826-44e3-8e55-6766f21fc582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:05.456686 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-9c8d03e9-e826-44e3-8e55-6766f21fc582 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.154444 Oct 27 17:40:05.457240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 501/971] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:40:05 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:40:06.481474 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ae7c4363-824a-4560-9653-9a47bd0b986f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:06.482016 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ae7c4363-824a-4560-9653-9a47bd0b986f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:06.484416 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=38 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:40:06.489962 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ae7c4363-824a-4560-9653-9a47bd0b986f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:06.490439 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ae7c4363-824a-4560-9653-9a47bd0b986f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:06.490873 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ae7c4363-824a-4560-9653-9a47bd0b986f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:06.491548 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ae7c4363-824a-4560-9653-9a47bd0b986f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:06.492032 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ae7c4363-824a-4560-9653-9a47bd0b986f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:06.492448 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ae7c4363-824a-4560-9653-9a47bd0b986f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:06.619429 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ae7c4363-824a-4560-9653-9a47bd0b986f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:06.627486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ae7c4363-824a-4560-9653-9a47bd0b986f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:06.628980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ae7c4363-824a-4560-9653-9a47bd0b986f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:06.630155 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ae7c4363-824a-4560-9653-9a47bd0b986f tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.152694 Oct 27 17:40:06.630912 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 471/972] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:40:06 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:40:07.655580 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4557c668-5dbb-4050-b071-ebf6b92804d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:07.656214 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4557c668-5dbb-4050-b071-ebf6b92804d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:07.662592 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4557c668-5dbb-4050-b071-ebf6b92804d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:07.663066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4557c668-5dbb-4050-b071-ebf6b92804d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:07.663496 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4557c668-5dbb-4050-b071-ebf6b92804d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:07.664207 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4557c668-5dbb-4050-b071-ebf6b92804d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:07.664651 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4557c668-5dbb-4050-b071-ebf6b92804d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:07.665067 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4557c668-5dbb-4050-b071-ebf6b92804d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:07.792809 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4557c668-5dbb-4050-b071-ebf6b92804d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:07.800800 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4557c668-5dbb-4050-b071-ebf6b92804d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:07.802232 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4557c668-5dbb-4050-b071-ebf6b92804d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:07.803374 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4557c668-5dbb-4050-b071-ebf6b92804d2 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.151729 Oct 27 17:40:07.803986 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 502/973] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:40:07 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:40:08.333274 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-842c06ec-5ad3-4f2a-86f5-b58a377eb17f req-64002ec5-a0a0-4f9f-b79b-445734e23764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef8a04a-8ed9-43bd-8a43-8ed991b5d746", "name": "network-vif-plugged", "status": "completed", "tag": "e44c2473-a49a-4e38-91e6-b32e6e8065d8"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:40:08.344147 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-842c06ec-5ad3-4f2a-86f5-b58a377eb17f req-64002ec5-a0a0-4f9f-b79b-445734e23764 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:08.344659 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-842c06ec-5ad3-4f2a-86f5-b58a377eb17f req-64002ec5-a0a0-4f9f-b79b-445734e23764 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:08.345077 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-842c06ec-5ad3-4f2a-86f5-b58a377eb17f req-64002ec5-a0a0-4f9f-b79b-445734e23764 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:08.357418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-842c06ec-5ad3-4f2a-86f5-b58a377eb17f req-64002ec5-a0a0-4f9f-b79b-445734e23764 service nova] Creating event network-vif-plugged:e44c2473-a49a-4e38-91e6-b32e6e8065d8 for instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 on hv-cinder-86283 Oct 27 17:40:08.363031 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-842c06ec-5ad3-4f2a-86f5-b58a377eb17f req-64002ec5-a0a0-4f9f-b79b-445734e23764 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033481 Oct 27 17:40:08.364190 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 472/974] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:40:08.829388 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8af1954a-55b2-464a-b9a0-0d720377efed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:08.829955 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8af1954a-55b2-464a-b9a0-0d720377efed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:08.832275 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:40:08.837684 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8af1954a-55b2-464a-b9a0-0d720377efed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:08.838165 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8af1954a-55b2-464a-b9a0-0d720377efed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:08.838625 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8af1954a-55b2-464a-b9a0-0d720377efed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:08.839287 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8af1954a-55b2-464a-b9a0-0d720377efed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:08.839759 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8af1954a-55b2-464a-b9a0-0d720377efed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:08.840186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8af1954a-55b2-464a-b9a0-0d720377efed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:08.967503 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8af1954a-55b2-464a-b9a0-0d720377efed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:08.975872 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8af1954a-55b2-464a-b9a0-0d720377efed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:08.977319 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8af1954a-55b2-464a-b9a0-0d720377efed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:08.978510 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8af1954a-55b2-464a-b9a0-0d720377efed tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.153717 Oct 27 17:40:08.979068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 503/975] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:40:08 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:40:10.004770 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d206eda0-31fa-4f7c-9539-508a4c97f769 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:10.005476 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d206eda0-31fa-4f7c-9539-508a4c97f769 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:10.011824 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d206eda0-31fa-4f7c-9539-508a4c97f769 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:10.012286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d206eda0-31fa-4f7c-9539-508a4c97f769 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:10.012715 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d206eda0-31fa-4f7c-9539-508a4c97f769 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:10.013399 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d206eda0-31fa-4f7c-9539-508a4c97f769 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:10.013842 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d206eda0-31fa-4f7c-9539-508a4c97f769 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:10.014256 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d206eda0-31fa-4f7c-9539-508a4c97f769 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:10.145822 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d206eda0-31fa-4f7c-9539-508a4c97f769 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:10.154452 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d206eda0-31fa-4f7c-9539-508a4c97f769 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:10.156895 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d206eda0-31fa-4f7c-9539-508a4c97f769 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:10.157764 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d206eda0-31fa-4f7c-9539-508a4c97f769 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1730 microversion: 2.20 time: 0.157771 Oct 27 17:40:10.158596 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 473/976] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:40:09 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:40:11.183425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c34c025d-d008-4ca5-b8dd-13274332682c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:11.184062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c34c025d-d008-4ca5-b8dd-13274332682c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:11.191961 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c34c025d-d008-4ca5-b8dd-13274332682c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:11.192499 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c34c025d-d008-4ca5-b8dd-13274332682c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:11.192944 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c34c025d-d008-4ca5-b8dd-13274332682c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:11.193763 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c34c025d-d008-4ca5-b8dd-13274332682c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:11.194216 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c34c025d-d008-4ca5-b8dd-13274332682c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:11.194645 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c34c025d-d008-4ca5-b8dd-13274332682c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:11.323306 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c34c025d-d008-4ca5-b8dd-13274332682c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:11.331388 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c34c025d-d008-4ca5-b8dd-13274332682c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:11.332858 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c34c025d-d008-4ca5-b8dd-13274332682c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:11.334004 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c34c025d-d008-4ca5-b8dd-13274332682c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1717 microversion: 2.20 time: 0.154520 Oct 27 17:40:11.334551 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 504/977] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:40:11 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:40:11.355187 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-5997aca5-7c3e-43aa-ba46-5e713601f7ad tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:11.355973 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-5997aca5-7c3e-43aa-ba46-5e713601f7ad tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:11.362698 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5997aca5-7c3e-43aa-ba46-5e713601f7ad tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:11.363176 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5997aca5-7c3e-43aa-ba46-5e713601f7ad tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:11.363605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5997aca5-7c3e-43aa-ba46-5e713601f7ad tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:11.364326 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5997aca5-7c3e-43aa-ba46-5e713601f7ad tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:11.364772 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5997aca5-7c3e-43aa-ba46-5e713601f7ad tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:11.365186 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5997aca5-7c3e-43aa-ba46-5e713601f7ad tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:11.387906 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-5997aca5-7c3e-43aa-ba46-5e713601f7ad tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/ips" status: 200 len: 145 microversion: 2.1 time: 0.036529 Oct 27 17:40:11.388503 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 474/978] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Oct 27 17:40:11 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:40:12.712710 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f2b5ec5a-7678-479f-a5af-8542ad390e01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df99947d-99ad-4122-a33a-44767081b103"}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:40:12.715127 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f2b5ec5a-7678-479f-a5af-8542ad390e01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:12.722308 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2b5ec5a-7678-479f-a5af-8542ad390e01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:12.722791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2b5ec5a-7678-479f-a5af-8542ad390e01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:12.723226 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2b5ec5a-7678-479f-a5af-8542ad390e01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:12.723937 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2b5ec5a-7678-479f-a5af-8542ad390e01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:12.724390 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2b5ec5a-7678-479f-a5af-8542ad390e01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:12.724813 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f2b5ec5a-7678-479f-a5af-8542ad390e01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:12.983896 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f2b5ec5a-7678-479f-a5af-8542ad390e01 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "POST /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274846 Oct 27 17:40:12.985122 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 505/979] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Oct 27 17:40:12 2022] POST /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:40:20.518677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4c19ec1a-e1da-41aa-9296-4cfae3a7b3aa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:20.520934 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4c19ec1a-e1da-41aa-9296-4cfae3a7b3aa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:20.527625 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4c19ec1a-e1da-41aa-9296-4cfae3a7b3aa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:20.528118 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4c19ec1a-e1da-41aa-9296-4cfae3a7b3aa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:20.528553 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4c19ec1a-e1da-41aa-9296-4cfae3a7b3aa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:20.529241 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4c19ec1a-e1da-41aa-9296-4cfae3a7b3aa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:20.529705 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4c19ec1a-e1da-41aa-9296-4cfae3a7b3aa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:20.530112 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4c19ec1a-e1da-41aa-9296-4cfae3a7b3aa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:20.532614 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:40:20.561042 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4c19ec1a-e1da-41aa-9296-4cfae3a7b3aa tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046797 Oct 27 17:40:20.561590 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 475/980] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:40:20 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:40:20.574245 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6b825f7b-a740-46cc-898a-76aa0b506775 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:20.574846 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-6b825f7b-a740-46cc-898a-76aa0b506775 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:20.581334 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b825f7b-a740-46cc-898a-76aa0b506775 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:20.581826 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b825f7b-a740-46cc-898a-76aa0b506775 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:20.582265 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b825f7b-a740-46cc-898a-76aa0b506775 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:20.582969 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b825f7b-a740-46cc-898a-76aa0b506775 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:20.583425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b825f7b-a740-46cc-898a-76aa0b506775 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:20.583893 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6b825f7b-a740-46cc-898a-76aa0b506775 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:20.586400 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:40:20.615293 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6b825f7b-a740-46cc-898a-76aa0b506775 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments/df99947d-99ad-4122-a33a-44767081b103" status: 200 len: 194 microversion: 2.1 time: 0.046079 Oct 27 17:40:20.615885 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 506/981] 10.222.0.36 () {58 vars in 1413 bytes} [Thu Oct 27 17:40:20 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments/df99947d-99ad-4122-a33a-44767081b103 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:40:21.939980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-cce1d2b1-56d2-443b-8bbb-8d9a8e6f31c1 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "750dc78d-07d0-429c-82d5-8bf75f1c61ef"}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:40:21.942267 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-cce1d2b1-56d2-443b-8bbb-8d9a8e6f31c1 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:21.948518 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cce1d2b1-56d2-443b-8bbb-8d9a8e6f31c1 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:21.948995 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cce1d2b1-56d2-443b-8bbb-8d9a8e6f31c1 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:21.949429 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cce1d2b1-56d2-443b-8bbb-8d9a8e6f31c1 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:21.950103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cce1d2b1-56d2-443b-8bbb-8d9a8e6f31c1 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:21.950549 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cce1d2b1-56d2-443b-8bbb-8d9a8e6f31c1 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:21.950964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cce1d2b1-56d2-443b-8bbb-8d9a8e6f31c1 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:22.390687 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-cce1d2b1-56d2-443b-8bbb-8d9a8e6f31c1 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "POST /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.454953 Oct 27 17:40:22.391290 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 476/982] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Oct 27 17:40:21 2022] POST /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:40:28.469492 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-61018321-9157-4234-8980-9b7dc5b2ad16 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:28.470074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-61018321-9157-4234-8980-9b7dc5b2ad16 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:28.473498 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-995442fb-4223-41a5-84e5-d61415827fd3 req-813a47b7-631a-47ad-bf41-abce7c113e98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26a883d9-7208-49ab-9775-557bba9f7efd", "tag": "469bd0cf-71f5-4704-9199-a07d128929ab"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:40:28.477527 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61018321-9157-4234-8980-9b7dc5b2ad16 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:28.478003 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61018321-9157-4234-8980-9b7dc5b2ad16 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:28.478431 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61018321-9157-4234-8980-9b7dc5b2ad16 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:28.479889 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61018321-9157-4234-8980-9b7dc5b2ad16 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:28.480345 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61018321-9157-4234-8980-9b7dc5b2ad16 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:28.480763 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61018321-9157-4234-8980-9b7dc5b2ad16 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:28.483965 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-995442fb-4223-41a5-84e5-d61415827fd3 req-813a47b7-631a-47ad-bf41-abce7c113e98 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:28.484571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-995442fb-4223-41a5-84e5-d61415827fd3 req-813a47b7-631a-47ad-bf41-abce7c113e98 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:28.485141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-995442fb-4223-41a5-84e5-d61415827fd3 req-813a47b7-631a-47ad-bf41-abce7c113e98 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:28.496890 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-995442fb-4223-41a5-84e5-d61415827fd3 req-813a47b7-631a-47ad-bf41-abce7c113e98 service nova] Creating event network-changed:469bd0cf-71f5-4704-9199-a07d128929ab for instance 26a883d9-7208-49ab-9775-557bba9f7efd on hv-cinder-86283 Oct 27 17:40:28.502119 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-995442fb-4223-41a5-84e5-d61415827fd3 req-813a47b7-631a-47ad-bf41-abce7c113e98 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034289 Oct 27 17:40:28.502709 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 477/983] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:40:28.508530 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-61018321-9157-4234-8980-9b7dc5b2ad16 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Going to try to terminate instance {{(pid=119047) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:40:28.588292 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-61018321-9157-4234-8980-9b7dc5b2ad16 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "DELETE /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 204 len: 0 microversion: 2.1 time: 0.122863 Oct 27 17:40:28.592181 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 507/984] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:40:28 2022] DELETE /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:40:28.597906 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-770a944b-d706-47b3-8deb-87504db6cbec tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:28.598600 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-770a944b-d706-47b3-8deb-87504db6cbec tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:28.604653 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-770a944b-d706-47b3-8deb-87504db6cbec tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:28.605130 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-770a944b-d706-47b3-8deb-87504db6cbec tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:28.605561 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-770a944b-d706-47b3-8deb-87504db6cbec tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:28.606286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-770a944b-d706-47b3-8deb-87504db6cbec tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:28.606726 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-770a944b-d706-47b3-8deb-87504db6cbec tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:28.607147 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-770a944b-d706-47b3-8deb-87504db6cbec tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:28.738135 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-770a944b-d706-47b3-8deb-87504db6cbec tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:28.746721 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-770a944b-d706-47b3-8deb-87504db6cbec tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.153196 Oct 27 17:40:28.747585 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 478/985] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:40:28 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:40:29.772320 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c4ca88e9-f326-4941-8142-54253eac0fb9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:29.773017 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c4ca88e9-f326-4941-8142-54253eac0fb9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:29.779368 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c4ca88e9-f326-4941-8142-54253eac0fb9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:29.779912 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c4ca88e9-f326-4941-8142-54253eac0fb9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:29.780343 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c4ca88e9-f326-4941-8142-54253eac0fb9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:29.781024 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c4ca88e9-f326-4941-8142-54253eac0fb9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:29.781471 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c4ca88e9-f326-4941-8142-54253eac0fb9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:29.781887 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c4ca88e9-f326-4941-8142-54253eac0fb9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:29.965297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c4ca88e9-f326-4941-8142-54253eac0fb9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:29.973288 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c4ca88e9-f326-4941-8142-54253eac0fb9 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.205883 Oct 27 17:40:29.973844 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 508/986] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:40:29 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:40:30.996536 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-205f7249-518a-4183-937d-c098fa3aa790 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:30.997147 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-205f7249-518a-4183-937d-c098fa3aa790 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:31.003644 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-205f7249-518a-4183-937d-c098fa3aa790 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:31.004156 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-205f7249-518a-4183-937d-c098fa3aa790 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:31.004592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-205f7249-518a-4183-937d-c098fa3aa790 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:31.005273 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-205f7249-518a-4183-937d-c098fa3aa790 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:31.005725 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-205f7249-518a-4183-937d-c098fa3aa790 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:31.006145 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-205f7249-518a-4183-937d-c098fa3aa790 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:31.193287 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-205f7249-518a-4183-937d-c098fa3aa790 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:31.201509 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-205f7249-518a-4183-937d-c098fa3aa790 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1570 microversion: 2.1 time: 0.208752 Oct 27 17:40:31.202262 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 479/987] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:40:30 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1570 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:40:31.912521 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-49034ab5-6c69-4191-9db1-d28828515719 req-2a67a5d2-4df5-4d6f-a5ba-6941af609be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a883d9-7208-49ab-9775-557bba9f7efd", "name": "network-vif-deleted", "tag": "469bd0cf-71f5-4704-9199-a07d128929ab"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:40:31.924258 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-49034ab5-6c69-4191-9db1-d28828515719 req-2a67a5d2-4df5-4d6f-a5ba-6941af609be5 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:31.925251 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-49034ab5-6c69-4191-9db1-d28828515719 req-2a67a5d2-4df5-4d6f-a5ba-6941af609be5 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:31.925688 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-49034ab5-6c69-4191-9db1-d28828515719 req-2a67a5d2-4df5-4d6f-a5ba-6941af609be5 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:31.937131 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-49034ab5-6c69-4191-9db1-d28828515719 req-2a67a5d2-4df5-4d6f-a5ba-6941af609be5 service nova] Creating event network-vif-deleted:469bd0cf-71f5-4704-9199-a07d128929ab for instance 26a883d9-7208-49ab-9775-557bba9f7efd on hv-cinder-86283 Oct 27 17:40:31.942903 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-49034ab5-6c69-4191-9db1-d28828515719 req-2a67a5d2-4df5-4d6f-a5ba-6941af609be5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034353 Oct 27 17:40:31.944117 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 509/988] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:40:32.043884 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-56cd6480-a1a7-4a01-9404-eb5180fa7544 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:32.046027 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-56cd6480-a1a7-4a01-9404-eb5180fa7544 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:32.053702 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-56cd6480-a1a7-4a01-9404-eb5180fa7544 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:32.054463 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-56cd6480-a1a7-4a01-9404-eb5180fa7544 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:32.055050 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-56cd6480-a1a7-4a01-9404-eb5180fa7544 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:32.055929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-56cd6480-a1a7-4a01-9404-eb5180fa7544 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:32.056561 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-56cd6480-a1a7-4a01-9404-eb5180fa7544 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:32.057132 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-56cd6480-a1a7-4a01-9404-eb5180fa7544 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:32.093037 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-56cd6480-a1a7-4a01-9404-eb5180fa7544 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052984 Oct 27 17:40:32.094271 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 480/989] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:40:32 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:40:32.226696 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-aba52340-3977-4fc9-a12b-7a6053edfa5f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:32.227501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-aba52340-3977-4fc9-a12b-7a6053edfa5f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:32.236438 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aba52340-3977-4fc9-a12b-7a6053edfa5f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:32.237575 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aba52340-3977-4fc9-a12b-7a6053edfa5f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:32.238098 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aba52340-3977-4fc9-a12b-7a6053edfa5f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:32.238889 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aba52340-3977-4fc9-a12b-7a6053edfa5f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:32.239478 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aba52340-3977-4fc9-a12b-7a6053edfa5f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:32.240012 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aba52340-3977-4fc9-a12b-7a6053edfa5f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:32.240261 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-32a92cec-3ea5-4914-a5fd-46a203ac5096 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:32.240827 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-32a92cec-3ea5-4914-a5fd-46a203ac5096 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:32.247797 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-32a92cec-3ea5-4914-a5fd-46a203ac5096 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:32.248615 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-32a92cec-3ea5-4914-a5fd-46a203ac5096 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:32.249528 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-32a92cec-3ea5-4914-a5fd-46a203ac5096 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:32.250428 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-32a92cec-3ea5-4914-a5fd-46a203ac5096 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:32.251074 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-32a92cec-3ea5-4914-a5fd-46a203ac5096 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:32.251688 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-32a92cec-3ea5-4914-a5fd-46a203ac5096 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:32.287584 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-32a92cec-3ea5-4914-a5fd-46a203ac5096 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments/df99947d-99ad-4122-a33a-44767081b103" status: 200 len: 194 microversion: 2.1 time: 0.053541 Oct 27 17:40:32.293527 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 481/990] 10.222.0.36 () {58 vars in 1413 bytes} [Thu Oct 27 17:40:32 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments/df99947d-99ad-4122-a33a-44767081b103 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:40:32.300916 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-1b635cd4-828a-402f-a194-9da5ce1b884f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:32.301647 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-1b635cd4-828a-402f-a194-9da5ce1b884f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:32.308446 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1b635cd4-828a-402f-a194-9da5ce1b884f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:32.309236 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1b635cd4-828a-402f-a194-9da5ce1b884f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:32.309945 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1b635cd4-828a-402f-a194-9da5ce1b884f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:32.311151 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1b635cd4-828a-402f-a194-9da5ce1b884f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:32.311735 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1b635cd4-828a-402f-a194-9da5ce1b884f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:32.312363 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1b635cd4-828a-402f-a194-9da5ce1b884f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:32.328193 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-aba52340-3977-4fc9-a12b-7a6053edfa5f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:32.336375 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-aba52340-3977-4fc9-a12b-7a6053edfa5f tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1220 microversion: 2.1 time: 0.113881 Oct 27 17:40:32.336948 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 510/991] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:40:32 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1220 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:40:32.404453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-1b635cd4-828a-402f-a194-9da5ce1b884f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lazy-loading 'services' on Instance uuid 93b27159-1b55-4d07-95ab-6b31d9376fcc {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:40:32.483206 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-1b635cd4-828a-402f-a194-9da5ce1b884f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "DELETE /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments/df99947d-99ad-4122-a33a-44767081b103" status: 202 len: 0 microversion: 2.1 time: 0.188199 Oct 27 17:40:32.483983 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 482/992] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Oct 27 17:40:32 2022] DELETE /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments/df99947d-99ad-4122-a33a-44767081b103 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 17:40:33.359916 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-fb8a27a2-d843-4cb0-88b1-8450905c7f90 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:33.360529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-fb8a27a2-d843-4cb0-88b1-8450905c7f90 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:33.367532 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fb8a27a2-d843-4cb0-88b1-8450905c7f90 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:33.368036 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fb8a27a2-d843-4cb0-88b1-8450905c7f90 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:33.368465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fb8a27a2-d843-4cb0-88b1-8450905c7f90 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:33.369151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fb8a27a2-d843-4cb0-88b1-8450905c7f90 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:33.369605 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fb8a27a2-d843-4cb0-88b1-8450905c7f90 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:33.370029 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fb8a27a2-d843-4cb0-88b1-8450905c7f90 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:33.402444 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fb8a27a2-d843-4cb0-88b1-8450905c7f90 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:33.402919 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fb8a27a2-d843-4cb0-88b1-8450905c7f90 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:33.403347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fb8a27a2-d843-4cb0-88b1-8450905c7f90 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:33.403809 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.objects.instance [None req-fb8a27a2-d843-4cb0-88b1-8450905c7f90 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lazy-loading 'fault' on Instance uuid 26a883d9-7208-49ab-9775-557bba9f7efd {{(pid=119047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:40:33.443012 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fb8a27a2-d843-4cb0-88b1-8450905c7f90 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c92a21193a43e4838e625f2d2e4dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c77f9e29f141c7b5a02d8b7eb62da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:33.450645 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-fb8a27a2-d843-4cb0-88b1-8450905c7f90 tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 200 len: 1225 microversion: 2.1 time: 0.094683 Oct 27 17:40:33.451210 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 511/993] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:40:33 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:40:34.476071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2d6e3ee9-d53c-48d2-832c-3c2c9ee5f57c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:34.476769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2d6e3ee9-d53c-48d2-832c-3c2c9ee5f57c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] [instance: 26a883d9-7208-49ab-9775-557bba9f7efd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:34.482925 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2d6e3ee9-d53c-48d2-832c-3c2c9ee5f57c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:34.483404 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2d6e3ee9-d53c-48d2-832c-3c2c9ee5f57c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:34.483868 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2d6e3ee9-d53c-48d2-832c-3c2c9ee5f57c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:34.484564 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2d6e3ee9-d53c-48d2-832c-3c2c9ee5f57c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:34.485001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2d6e3ee9-d53c-48d2-832c-3c2c9ee5f57c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:34.485421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2d6e3ee9-d53c-48d2-832c-3c2c9ee5f57c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:34.498917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-2d6e3ee9-d53c-48d2-832c-3c2c9ee5f57c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] HTTP exception thrown: Instance 26a883d9-7208-49ab-9775-557bba9f7efd could not be found. Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2d6e3ee9-d53c-48d2-832c-3c2c9ee5f57c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Request method failure captured: Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd HTTP/1.1 Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsEC1peXhxnRpiL10Ox5rfOBPwFQOB0V3RkWnSvFWHVxeemPZiPd_0C8NkzV2TFAMLUSzeiTGVKn4mFz0yd09NbRBQt7i2O6hSQAMQBZXYDBAOQzqF2A3WWTpMAd5pSgPPxAn0c572wCyZPoIlD2Q2kokqd6hFZ7Fte4Vs6Xy8C7UI8 Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: d8c77f9e29f141c7b5a02d8b7eb62da3 Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-TestShelveInstance-269625979 Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:40:34.500523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:40:34.502220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d8c77f9e29f141c7b5a02d8b7eb62da3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d8c77f9e29f141c7b5a02d8b7eb62da3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d8c77f9e29f141c7b5a02d8b7eb62da3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d8c77f9e29f141c7b5a02d8b7eb62da3"}]}] Oct 27 17:40:34.502220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-TestShelveInstance-269625979 Oct 27 17:40:34.502220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: d8c77f9e29f141c7b5a02d8b7eb62da3 Oct 27 17:40:34.502220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-TestShelveInstance-269625979 Oct 27 17:40:34.502220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-TestShelveInstance-269625979-project Oct 27 17:40:34.502220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:40:34.502220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:40:34.502220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 76c92a21193a43e4838e625f2d2e4dd5 Oct 27 17:40:34.502220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-TestShelveInstance-269625979-project Oct 27 17:40:34.502220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:40:34.502220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance 26a883d9-7208-49ab-9775-557bba9f7efd could not be found. Oct 27 17:40:34.502220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '26a883d9-7208-49ab-9775-557bba9f7efd'} Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a883d9-7208-49ab-9775-557bba9f7efd could not be found. Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:40:34.503309 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a883d9-7208-49ab-9775-557bba9f7efd could not be found. Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a883d9-7208-49ab-9775-557bba9f7efd could not be found. Oct 27 17:40:34.504933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:34.506489 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2d6e3ee9-d53c-48d2-832c-3c2c9ee5f57c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Returning 404 to user: Instance 26a883d9-7208-49ab-9775-557bba9f7efd could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:40:34.506489 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2d6e3ee9-d53c-48d2-832c-3c2c9ee5f57c tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd" status: 404 len: 111 microversion: 2.1 time: 0.031343 Oct 27 17:40:34.506489 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 483/994] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:40:34 2022] GET /compute/v2.1/servers/26a883d9-7208-49ab-9775-557bba9f7efd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:40:34.663045 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-835dc5d1-d22b-4cbf-83c2-e31f0677998c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:34.663726 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-835dc5d1-d22b-4cbf-83c2-e31f0677998c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:34.671344 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d19084a9-f07b-4285-a1f7-c3b1a035883e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] Calling method '.version_select at 0x7f0788579700>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:34.671561 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-835dc5d1-d22b-4cbf-83c2-e31f0677998c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:34.671983 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-835dc5d1-d22b-4cbf-83c2-e31f0677998c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:34.672595 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-835dc5d1-d22b-4cbf-83c2-e31f0677998c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:34.673787 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-835dc5d1-d22b-4cbf-83c2-e31f0677998c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:34.674200 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-835dc5d1-d22b-4cbf-83c2-e31f0677998c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:34.675325 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-835dc5d1-d22b-4cbf-83c2-e31f0677998c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:34.691783 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d19084a9-f07b-4285-a1f7-c3b1a035883e tempest-TestShelveInstance-269625979 tempest-TestShelveInstance-269625979-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1230701945" status: 202 len: 0 microversion: 2.1 time: 0.024167 Oct 27 17:40:34.692377 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 484/995] 10.222.0.36 () {58 vars in 1254 bytes} [Thu Oct 27 17:40:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1230701945 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 17:40:34.736847 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-835dc5d1-d22b-4cbf-83c2-e31f0677998c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments/750dc78d-07d0-429c-82d5-8bf75f1c61ef" status: 200 len: 194 microversion: 2.1 time: 0.078694 Oct 27 17:40:34.737497 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 512/996] 10.222.0.36 () {58 vars in 1413 bytes} [Thu Oct 27 17:40:34 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments/750dc78d-07d0-429c-82d5-8bf75f1c61ef => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:40:34.748636 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-5b90feb2-7bfc-4962-bad5-2e3f0351834f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:34.749409 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-5b90feb2-7bfc-4962-bad5-2e3f0351834f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:34.756201 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5b90feb2-7bfc-4962-bad5-2e3f0351834f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:34.756696 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5b90feb2-7bfc-4962-bad5-2e3f0351834f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:34.757132 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5b90feb2-7bfc-4962-bad5-2e3f0351834f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:34.758051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5b90feb2-7bfc-4962-bad5-2e3f0351834f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:34.758510 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5b90feb2-7bfc-4962-bad5-2e3f0351834f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:34.758934 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5b90feb2-7bfc-4962-bad5-2e3f0351834f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:34.849141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-5b90feb2-7bfc-4962-bad5-2e3f0351834f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lazy-loading 'services' on Instance uuid 93b27159-1b55-4d07-95ab-6b31d9376fcc {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:40:34.920876 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-5b90feb2-7bfc-4962-bad5-2e3f0351834f tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "DELETE /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments/750dc78d-07d0-429c-82d5-8bf75f1c61ef" status: 202 len: 0 microversion: 2.1 time: 0.176136 Oct 27 17:40:34.921486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 485/997] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Oct 27 17:40:34 2022] DELETE /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments/750dc78d-07d0-429c-82d5-8bf75f1c61ef => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:40:36.111414 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-060c88bf-bf0e-4a52-a348-9fa4798329ee tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:36.113892 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-060c88bf-bf0e-4a52-a348-9fa4798329ee tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:36.121434 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-060c88bf-bf0e-4a52-a348-9fa4798329ee tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:36.122380 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-060c88bf-bf0e-4a52-a348-9fa4798329ee tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:36.123028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-060c88bf-bf0e-4a52-a348-9fa4798329ee tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:36.123953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-060c88bf-bf0e-4a52-a348-9fa4798329ee tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:36.124603 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-060c88bf-bf0e-4a52-a348-9fa4798329ee tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:36.125451 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-060c88bf-bf0e-4a52-a348-9fa4798329ee tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:36.160116 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-060c88bf-bf0e-4a52-a348-9fa4798329ee tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052569 Oct 27 17:40:36.163844 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 513/998] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:40:36 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 17:40:36.303804 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-17e38d04-c9fd-44c9-a546-95d627955241 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:36.308250 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-17e38d04-c9fd-44c9-a546-95d627955241 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:36.314945 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-17e38d04-c9fd-44c9-a546-95d627955241 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:36.316306 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-17e38d04-c9fd-44c9-a546-95d627955241 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:36.316898 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-17e38d04-c9fd-44c9-a546-95d627955241 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:36.317799 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-17e38d04-c9fd-44c9-a546-95d627955241 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:36.318410 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-17e38d04-c9fd-44c9-a546-95d627955241 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:36.318986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-17e38d04-c9fd-44c9-a546-95d627955241 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:36.351984 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-17e38d04-c9fd-44c9-a546-95d627955241 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054852 Oct 27 17:40:36.353174 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 486/999] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:40:36 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 17:40:36.425263 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-873db366-e377-4d5f-a306-3bdc39d00a11 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:36.426117 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-873db366-e377-4d5f-a306-3bdc39d00a11 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:36.433625 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-873db366-e377-4d5f-a306-3bdc39d00a11 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:36.434422 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-873db366-e377-4d5f-a306-3bdc39d00a11 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:36.435100 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-873db366-e377-4d5f-a306-3bdc39d00a11 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:36.436096 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-873db366-e377-4d5f-a306-3bdc39d00a11 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:36.436784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-873db366-e377-4d5f-a306-3bdc39d00a11 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:36.437433 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-873db366-e377-4d5f-a306-3bdc39d00a11 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:36.466575 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-873db366-e377-4d5f-a306-3bdc39d00a11 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Going to try to terminate instance {{(pid=119047) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:40:36.566563 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-873db366-e377-4d5f-a306-3bdc39d00a11 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "DELETE /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 204 len: 0 microversion: 2.1 time: 0.144459 Oct 27 17:40:36.567864 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 514/1000] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:40:36 2022] DELETE /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:40:36.583035 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8deedd01-b0cc-46cc-a5b3-30b3507b7b58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:36.583919 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8deedd01-b0cc-46cc-a5b3-30b3507b7b58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:36.586230 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:40:36.598571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8deedd01-b0cc-46cc-a5b3-30b3507b7b58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:36.599202 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8deedd01-b0cc-46cc-a5b3-30b3507b7b58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:36.599749 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8deedd01-b0cc-46cc-a5b3-30b3507b7b58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:36.600571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8deedd01-b0cc-46cc-a5b3-30b3507b7b58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:36.601129 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8deedd01-b0cc-46cc-a5b3-30b3507b7b58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:36.601648 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8deedd01-b0cc-46cc-a5b3-30b3507b7b58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:36.801266 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8deedd01-b0cc-46cc-a5b3-30b3507b7b58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:36.812306 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8deedd01-b0cc-46cc-a5b3-30b3507b7b58 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 200 len: 1673 microversion: 2.1 time: 0.239945 Oct 27 17:40:36.814129 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 487/1001] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:40:36 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 1673 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:40:37.836786 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-008c837d-284f-459b-b460-0785b895acb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:37.837598 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-008c837d-284f-459b-b460-0785b895acb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:37.845743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-008c837d-284f-459b-b460-0785b895acb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:37.846320 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-008c837d-284f-459b-b460-0785b895acb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:37.846843 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-008c837d-284f-459b-b460-0785b895acb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:37.847603 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-008c837d-284f-459b-b460-0785b895acb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:37.848146 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-008c837d-284f-459b-b460-0785b895acb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:37.848825 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-008c837d-284f-459b-b460-0785b895acb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:38.083090 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-008c837d-284f-459b-b460-0785b895acb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:38.091282 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-008c837d-284f-459b-b460-0785b895acb9 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 200 len: 1673 microversion: 2.1 time: 0.259038 Oct 27 17:40:38.091873 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 515/1002] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:40:37 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 1673 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:40:39.116685 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0618b302-1645-459a-889d-745f7e252242 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:39.117316 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-0618b302-1645-459a-889d-745f7e252242 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:39.124287 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0618b302-1645-459a-889d-745f7e252242 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:39.124772 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0618b302-1645-459a-889d-745f7e252242 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:39.125206 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0618b302-1645-459a-889d-745f7e252242 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:39.125900 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0618b302-1645-459a-889d-745f7e252242 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:39.126351 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0618b302-1645-459a-889d-745f7e252242 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:39.126769 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0618b302-1645-459a-889d-745f7e252242 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:39.468783 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0618b302-1645-459a-889d-745f7e252242 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:39.476811 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0618b302-1645-459a-889d-745f7e252242 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 200 len: 1673 microversion: 2.1 time: 0.364578 Oct 27 17:40:39.477381 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 488/1003] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:40:39 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 1673 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:40:40.501897 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2b2671c4-32b2-4375-8e56-940c4ed3ef53 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:40.503563 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2b2671c4-32b2-4375-8e56-940c4ed3ef53 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:40.505918 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:40:40.521192 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-5db14dff-bfc2-4ec0-9192-f610b81a191e req-7e548fea-8760-4d99-ab9c-a182cc5d6500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93b27159-1b55-4d07-95ab-6b31d9376fcc", "name": "network-vif-deleted", "tag": "fafb856a-ed24-421f-b6a8-a3cb9bd61b71"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:40:40.530154 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2b2671c4-32b2-4375-8e56-940c4ed3ef53 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:40.530659 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2b2671c4-32b2-4375-8e56-940c4ed3ef53 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:40.531289 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2b2671c4-32b2-4375-8e56-940c4ed3ef53 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:40.532041 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2b2671c4-32b2-4375-8e56-940c4ed3ef53 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:40.532505 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2b2671c4-32b2-4375-8e56-940c4ed3ef53 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:40.533295 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2b2671c4-32b2-4375-8e56-940c4ed3ef53 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:40.556525 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-5db14dff-bfc2-4ec0-9192-f610b81a191e req-7e548fea-8760-4d99-ab9c-a182cc5d6500 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:40.559047 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-5db14dff-bfc2-4ec0-9192-f610b81a191e req-7e548fea-8760-4d99-ab9c-a182cc5d6500 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:40.561208 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-5db14dff-bfc2-4ec0-9192-f610b81a191e req-7e548fea-8760-4d99-ab9c-a182cc5d6500 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:40.620146 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-5db14dff-bfc2-4ec0-9192-f610b81a191e req-7e548fea-8760-4d99-ab9c-a182cc5d6500 service nova] Creating event network-vif-deleted:fafb856a-ed24-421f-b6a8-a3cb9bd61b71 for instance 93b27159-1b55-4d07-95ab-6b31d9376fcc on hv-cinder-86283 Oct 27 17:40:40.636244 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-5db14dff-bfc2-4ec0-9192-f610b81a191e req-7e548fea-8760-4d99-ab9c-a182cc5d6500 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115302 Oct 27 17:40:40.644476 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 489/1004] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:40:40.684492 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2b2671c4-32b2-4375-8e56-940c4ed3ef53 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5477ed4bd13542e48263f08761a7ff03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d4d4a323694c4c9244df4f17342a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:40:40.693205 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2b2671c4-32b2-4375-8e56-940c4ed3ef53 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 200 len: 1605 microversion: 2.1 time: 0.195985 Oct 27 17:40:40.697060 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 516/1005] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:40:40 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 1605 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:40:41.729341 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a8694e1d-14c5-4467-be8b-4f181538c449 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:41.730575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-a8694e1d-14c5-4467-be8b-4f181538c449 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:41.738514 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a8694e1d-14c5-4467-be8b-4f181538c449 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:41.739910 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a8694e1d-14c5-4467-be8b-4f181538c449 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:41.740509 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a8694e1d-14c5-4467-be8b-4f181538c449 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:41.741395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a8694e1d-14c5-4467-be8b-4f181538c449 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:41.742027 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a8694e1d-14c5-4467-be8b-4f181538c449 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:41.742735 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-a8694e1d-14c5-4467-be8b-4f181538c449 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:41.759639 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-a8694e1d-14c5-4467-be8b-4f181538c449 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] HTTP exception thrown: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a8694e1d-14c5-4467-be8b-4f181538c449 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Request method failure captured: Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc HTTP/1.1 Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA3ZeoAVm4eLP-HT8wF-JAK3j7TWGmYaQUyHeJx6WZ-nCVnkDgPNaZI6E4C8zAhU1rP51uuW-RLu-Knm-skdA2o7AY36fKS4ONXB6ICUSQHfx5tiuVx2YC4nc-oStEFRyVufnMQhWDmfHZ4uIIk_P6eVg6lKCn4lwNgHgKlreRoZvo Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: a9d4d4a323694c4c9244df4f17342a35 Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:40:41.761537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:40:41.763048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9d4d4a323694c4c9244df4f17342a35"}]}] Oct 27 17:40:41.763048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:40:41.763048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: a9d4d4a323694c4c9244df4f17342a35 Oct 27 17:40:41.763048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:40:41.763048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-AttachVolumeTestJSON-389329975-project Oct 27 17:40:41.763048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:40:41.763048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:40:41.763048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 5477ed4bd13542e48263f08761a7ff03 Oct 27 17:40:41.763048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-AttachVolumeTestJSON-389329975-project Oct 27 17:40:41.763048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:40:41.763048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. Oct 27 17:40:41.763048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '93b27159-1b55-4d07-95ab-6b31d9376fcc'} Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:40:41.763891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. Oct 27 17:40:41.765082 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:41.767554 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a8694e1d-14c5-4467-be8b-4f181538c449 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Returning 404 to user: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:40:41.768483 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a8694e1d-14c5-4467-be8b-4f181538c449 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 404 len: 111 microversion: 2.1 time: 0.048568 Oct 27 17:40:41.778386 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-3cd7867d-094b-4ead-978f-11952dffebf7 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '.version_select at 0x7f07886c7040>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:41.779859 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 490/1006] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:40:41 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:40:41.797817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-3cd7867d-094b-4ead-978f-11952dffebf7 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1468830997" status: 202 len: 0 microversion: 2.1 time: 0.023662 Oct 27 17:40:41.798757 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 517/1007] 10.222.0.36 () {58 vars in 1221 bytes} [Thu Oct 27 17:40:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1468830997 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:40:45.219703 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-90c666e1-7ab1-4b05-b512-869db5dc778c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:45.220570 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-90c666e1-7ab1-4b05-b512-869db5dc778c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:45.227058 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90c666e1-7ab1-4b05-b512-869db5dc778c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:45.227539 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90c666e1-7ab1-4b05-b512-869db5dc778c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:45.228012 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90c666e1-7ab1-4b05-b512-869db5dc778c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:45.228706 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90c666e1-7ab1-4b05-b512-869db5dc778c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:45.229160 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90c666e1-7ab1-4b05-b512-869db5dc778c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:45.229585 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-90c666e1-7ab1-4b05-b512-869db5dc778c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:45.243440 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-90c666e1-7ab1-4b05-b512-869db5dc778c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] HTTP exception thrown: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-90c666e1-7ab1-4b05-b512-869db5dc778c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Request method failure captured: Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: DELETE /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc HTTP/1.1 Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA3ZeoAVm4eLP-HT8wF-JAK3j7TWGmYaQUyHeJx6WZ-nCVnkDgPNaZI6E4C8zAhU1rP51uuW-RLu-Knm-skdA2o7AY36fKS4ONXB6ICUSQHfx5tiuVx2YC4nc-oStEFRyVufnMQhWDmfHZ4uIIk_P6eVg6lKCn4lwNgHgKlreRoZvo Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: a9d4d4a323694c4c9244df4f17342a35 Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:40:45.245001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:40:45.246571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9d4d4a323694c4c9244df4f17342a35"}]}] Oct 27 17:40:45.246571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:40:45.246571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: a9d4d4a323694c4c9244df4f17342a35 Oct 27 17:40:45.246571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:40:45.246571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-AttachVolumeTestJSON-389329975-project Oct 27 17:40:45.246571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:40:45.246571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:40:45.246571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 5477ed4bd13542e48263f08761a7ff03 Oct 27 17:40:45.246571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-AttachVolumeTestJSON-389329975-project Oct 27 17:40:45.246571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:40:45.246571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. Oct 27 17:40:45.246571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '93b27159-1b55-4d07-95ab-6b31d9376fcc'} Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:40:45.247504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. Oct 27 17:40:45.248960 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:45.250472 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-90c666e1-7ab1-4b05-b512-869db5dc778c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Returning 404 to user: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:40:45.250472 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-90c666e1-7ab1-4b05-b512-869db5dc778c tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "DELETE /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 404 len: 111 microversion: 2.1 time: 0.030599 Oct 27 17:40:45.250472 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 491/1008] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:40:45 2022] DELETE /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:40:45.256133 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0e64ca37-6092-4ae2-916d-f58e092bff99 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:45.256783 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-0e64ca37-6092-4ae2-916d-f58e092bff99 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 93b27159-1b55-4d07-95ab-6b31d9376fcc] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:45.263626 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e64ca37-6092-4ae2-916d-f58e092bff99 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:45.264140 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e64ca37-6092-4ae2-916d-f58e092bff99 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:45.264577 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e64ca37-6092-4ae2-916d-f58e092bff99 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:45.265265 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e64ca37-6092-4ae2-916d-f58e092bff99 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:45.265716 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e64ca37-6092-4ae2-916d-f58e092bff99 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:45.266139 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e64ca37-6092-4ae2-916d-f58e092bff99 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:45.279085 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-0e64ca37-6092-4ae2-916d-f58e092bff99 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] HTTP exception thrown: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0e64ca37-6092-4ae2-916d-f58e092bff99 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Request method failure captured: Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc HTTP/1.1 Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA3ZeoAVm4eLP-HT8wF-JAK3j7TWGmYaQUyHeJx6WZ-nCVnkDgPNaZI6E4C8zAhU1rP51uuW-RLu-Knm-skdA2o7AY36fKS4ONXB6ICUSQHfx5tiuVx2YC4nc-oStEFRyVufnMQhWDmfHZ4uIIk_P6eVg6lKCn4lwNgHgKlreRoZvo Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: a9d4d4a323694c4c9244df4f17342a35 Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:40:45.280797 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:40:45.282407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9d4d4a323694c4c9244df4f17342a35"}]}] Oct 27 17:40:45.282407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:40:45.282407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: a9d4d4a323694c4c9244df4f17342a35 Oct 27 17:40:45.282407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:40:45.282407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-AttachVolumeTestJSON-389329975-project Oct 27 17:40:45.282407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:40:45.282407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:40:45.282407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 5477ed4bd13542e48263f08761a7ff03 Oct 27 17:40:45.282407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-AttachVolumeTestJSON-389329975-project Oct 27 17:40:45.282407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:40:45.282407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. Oct 27 17:40:45.282407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': '93b27159-1b55-4d07-95ab-6b31d9376fcc'} Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:40:45.283396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. Oct 27 17:40:45.284917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:40:45.286157 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0e64ca37-6092-4ae2-916d-f58e092bff99 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Returning 404 to user: Instance 93b27159-1b55-4d07-95ab-6b31d9376fcc could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:40:45.286157 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0e64ca37-6092-4ae2-916d-f58e092bff99 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc" status: 404 len: 111 microversion: 2.1 time: 0.031302 Oct 27 17:40:45.286157 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 518/1009] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:40:45 2022] GET /compute/v2.1/servers/93b27159-1b55-4d07-95ab-6b31d9376fcc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:40:46.418316 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6f4058f3-6df7-4dc1-a8c5-6485fb971848 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:46.418806 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6f4058f3-6df7-4dc1-a8c5-6485fb971848 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:46.426132 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6f4058f3-6df7-4dc1-a8c5-6485fb971848 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:46.426609 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6f4058f3-6df7-4dc1-a8c5-6485fb971848 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:46.427039 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6f4058f3-6df7-4dc1-a8c5-6485fb971848 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:46.427735 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6f4058f3-6df7-4dc1-a8c5-6485fb971848 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:46.428196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6f4058f3-6df7-4dc1-a8c5-6485fb971848 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:46.428612 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6f4058f3-6df7-4dc1-a8c5-6485fb971848 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:46.444353 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-6f4058f3-6df7-4dc1-a8c5-6485fb971848 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] HTTP exception thrown: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6f4058f3-6df7-4dc1-a8c5-6485fb971848 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Request method failure captured: Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: DELETE /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 HTTP/1.1 Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA3ZeoAVm4eLP-HT8wF-JAK3j7TWGmYaQUyHeJx6WZ-nCVnkDgPNaZI6E4C8zAhU1rP51uuW-RLu-Knm-skdA2o7AY36fKS4ONXB6ICUSQHfx5tiuVx2YC4nc-oStEFRyVufnMQhWDmfHZ4uIIk_P6eVg6lKCn4lwNgHgKlreRoZvo Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: a9d4d4a323694c4c9244df4f17342a35 Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:40:46.445870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:40:46.447455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9d4d4a323694c4c9244df4f17342a35"}]}] Oct 27 17:40:46.447455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:40:46.447455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: a9d4d4a323694c4c9244df4f17342a35 Oct 27 17:40:46.447455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:40:46.447455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-AttachVolumeTestJSON-389329975-project Oct 27 17:40:46.447455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:40:46.447455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:40:46.447455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 5477ed4bd13542e48263f08761a7ff03 Oct 27 17:40:46.447455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-AttachVolumeTestJSON-389329975-project Oct 27 17:40:46.447455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:40:46.447455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. Oct 27 17:40:46.447455 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '8a9f11af-ebc7-4b43-80e4-e03e24ae3490'} Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:40:46.448396 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. Oct 27 17:40:46.449855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:40:46.451435 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6f4058f3-6df7-4dc1-a8c5-6485fb971848 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Returning 404 to user: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:40:46.451435 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6f4058f3-6df7-4dc1-a8c5-6485fb971848 tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 404 len: 111 microversion: 2.1 time: 0.032711 Oct 27 17:40:46.451435 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 492/1010] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:40:46 2022] DELETE /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:40:46.455506 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-cef5d736-6196-49bf-8bb1-c51753243e2b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:40:46.456156 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-cef5d736-6196-49bf-8bb1-c51753243e2b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] [instance: 8a9f11af-ebc7-4b43-80e4-e03e24ae3490] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:40:46.462537 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cef5d736-6196-49bf-8bb1-c51753243e2b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:46.463023 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cef5d736-6196-49bf-8bb1-c51753243e2b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:46.463464 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cef5d736-6196-49bf-8bb1-c51753243e2b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:46.464184 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cef5d736-6196-49bf-8bb1-c51753243e2b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:40:46.464644 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cef5d736-6196-49bf-8bb1-c51753243e2b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:40:46.465077 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cef5d736-6196-49bf-8bb1-c51753243e2b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:40:46.478910 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-cef5d736-6196-49bf-8bb1-c51753243e2b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] HTTP exception thrown: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-cef5d736-6196-49bf-8bb1-c51753243e2b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Request method failure captured: Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 HTTP/1.1 Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA3ZeoAVm4eLP-HT8wF-JAK3j7TWGmYaQUyHeJx6WZ-nCVnkDgPNaZI6E4C8zAhU1rP51uuW-RLu-Knm-skdA2o7AY36fKS4ONXB6ICUSQHfx5tiuVx2YC4nc-oStEFRyVufnMQhWDmfHZ4uIIk_P6eVg6lKCn4lwNgHgKlreRoZvo Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: a9d4d4a323694c4c9244df4f17342a35 Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:40:46.480403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:40:46.481946 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a9d4d4a323694c4c9244df4f17342a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a9d4d4a323694c4c9244df4f17342a35"}]}] Oct 27 17:40:46.481946 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:40:46.481946 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: a9d4d4a323694c4c9244df4f17342a35 Oct 27 17:40:46.481946 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-AttachVolumeTestJSON-389329975 Oct 27 17:40:46.481946 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-AttachVolumeTestJSON-389329975-project Oct 27 17:40:46.481946 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:40:46.481946 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:40:46.481946 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 5477ed4bd13542e48263f08761a7ff03 Oct 27 17:40:46.481946 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-AttachVolumeTestJSON-389329975-project Oct 27 17:40:46.481946 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:40:46.481946 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. Oct 27 17:40:46.481946 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': '8a9f11af-ebc7-4b43-80e4-e03e24ae3490'} Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:40:46.482735 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. Oct 27 17:40:46.484073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:40:46.485142 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-cef5d736-6196-49bf-8bb1-c51753243e2b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] Returning 404 to user: Instance 8a9f11af-ebc7-4b43-80e4-e03e24ae3490 could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:40:46.485142 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-cef5d736-6196-49bf-8bb1-c51753243e2b tempest-AttachVolumeTestJSON-389329975 tempest-AttachVolumeTestJSON-389329975-project] 10.222.0.36 "GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490" status: 404 len: 111 microversion: 2.1 time: 0.030123 Oct 27 17:40:46.485142 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 519/1011] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:40:46 2022] GET /compute/v2.1/servers/8a9f11af-ebc7-4b43-80e4-e03e24ae3490 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:41:12.573440 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-03b82a7c-5eec-4a2f-95ad-fb37d46ea6ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:12.574030 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-03b82a7c-5eec-4a2f-95ad-fb37d46ea6ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:12.576227 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=11 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:41:12.577069 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:41:12.583390 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-03b82a7c-5eec-4a2f-95ad-fb37d46ea6ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:12.583906 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-03b82a7c-5eec-4a2f-95ad-fb37d46ea6ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:12.584336 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-03b82a7c-5eec-4a2f-95ad-fb37d46ea6ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:12.585022 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-03b82a7c-5eec-4a2f-95ad-fb37d46ea6ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:12.585468 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-03b82a7c-5eec-4a2f-95ad-fb37d46ea6ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:12.585886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-03b82a7c-5eec-4a2f-95ad-fb37d46ea6ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:12.611391 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-03b82a7c-5eec-4a2f-95ad-fb37d46ea6ea tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/ips" status: 200 len: 151 microversion: 2.1 time: 0.041813 Oct 27 17:41:12.612003 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 493/1012] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Oct 27 17:41:12 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:13.950085 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d39e4f22-0d9d-4d78-b50a-e58d8420ee3b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04f9d5ff-ac74-4ebb-a71c-522dd20e4f62"}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:41:13.950085 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d39e4f22-0d9d-4d78-b50a-e58d8420ee3b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:13.951346 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:41:13.952813 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:41:13.960442 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d39e4f22-0d9d-4d78-b50a-e58d8420ee3b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:13.960988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d39e4f22-0d9d-4d78-b50a-e58d8420ee3b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:13.961430 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d39e4f22-0d9d-4d78-b50a-e58d8420ee3b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:13.962131 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d39e4f22-0d9d-4d78-b50a-e58d8420ee3b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:13.962620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d39e4f22-0d9d-4d78-b50a-e58d8420ee3b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:13.963047 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d39e4f22-0d9d-4d78-b50a-e58d8420ee3b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:14.278549 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d39e4f22-0d9d-4d78-b50a-e58d8420ee3b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "POST /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336379 Oct 27 17:41:14.279256 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 520/1013] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Oct 27 17:41:13 2022] POST /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:21.933441 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-420bcc0e-5140-4937-b8cc-b59b00e4f231 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:21.933922 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-420bcc0e-5140-4937-b8cc-b59b00e4f231 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:21.940470 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-420bcc0e-5140-4937-b8cc-b59b00e4f231 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:21.940946 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-420bcc0e-5140-4937-b8cc-b59b00e4f231 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:21.941378 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-420bcc0e-5140-4937-b8cc-b59b00e4f231 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:21.942056 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-420bcc0e-5140-4937-b8cc-b59b00e4f231 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:21.942505 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-420bcc0e-5140-4937-b8cc-b59b00e4f231 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:21.942923 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-420bcc0e-5140-4937-b8cc-b59b00e4f231 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:22.021752 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-420bcc0e-5140-4937-b8cc-b59b00e4f231 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lazy-loading 'services' on Instance uuid df713ea3-3864-4216-8d98-2d008ac2baab {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:41:22.092137 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-420bcc0e-5140-4937-b8cc-b59b00e4f231 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "DELETE /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments/04f9d5ff-ac74-4ebb-a71c-522dd20e4f62" status: 202 len: 0 microversion: 2.1 time: 0.162281 Oct 27 17:41:22.092670 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 494/1014] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Oct 27 17:41:21 2022] DELETE /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments/04f9d5ff-ac74-4ebb-a71c-522dd20e4f62 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:41:22.102482 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d1aa7321-ffca-42d9-b093-43f55214fe53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:22.104952 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d1aa7321-ffca-42d9-b093-43f55214fe53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:22.111339 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1aa7321-ffca-42d9-b093-43f55214fe53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:22.111865 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1aa7321-ffca-42d9-b093-43f55214fe53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:22.112302 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1aa7321-ffca-42d9-b093-43f55214fe53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:22.113001 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1aa7321-ffca-42d9-b093-43f55214fe53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:22.113453 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1aa7321-ffca-42d9-b093-43f55214fe53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:22.113871 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d1aa7321-ffca-42d9-b093-43f55214fe53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:22.144488 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d1aa7321-ffca-42d9-b093-43f55214fe53 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047005 Oct 27 17:41:22.145041 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 521/1015] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:41:22 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:41:23.157722 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-02b5b2ac-b4fd-44f0-8a9d-ed15145f7d10 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:23.160022 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-02b5b2ac-b4fd-44f0-8a9d-ed15145f7d10 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:23.166910 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-02b5b2ac-b4fd-44f0-8a9d-ed15145f7d10 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:23.167388 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-02b5b2ac-b4fd-44f0-8a9d-ed15145f7d10 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:23.167845 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-02b5b2ac-b4fd-44f0-8a9d-ed15145f7d10 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:23.168533 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-02b5b2ac-b4fd-44f0-8a9d-ed15145f7d10 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:23.168984 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-02b5b2ac-b4fd-44f0-8a9d-ed15145f7d10 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:23.169399 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-02b5b2ac-b4fd-44f0-8a9d-ed15145f7d10 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:23.198858 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-02b5b2ac-b4fd-44f0-8a9d-ed15145f7d10 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045516 Oct 27 17:41:23.199405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 495/1016] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:41:23 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:24.212515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-066dd68a-ba32-4a79-9902-a2f225a4f93b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:24.214612 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-066dd68a-ba32-4a79-9902-a2f225a4f93b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:24.221358 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-066dd68a-ba32-4a79-9902-a2f225a4f93b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:24.221840 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-066dd68a-ba32-4a79-9902-a2f225a4f93b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:24.222274 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-066dd68a-ba32-4a79-9902-a2f225a4f93b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:24.222956 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-066dd68a-ba32-4a79-9902-a2f225a4f93b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:24.223410 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-066dd68a-ba32-4a79-9902-a2f225a4f93b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:24.223874 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-066dd68a-ba32-4a79-9902-a2f225a4f93b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:24.252951 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-066dd68a-ba32-4a79-9902-a2f225a4f93b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045070 Oct 27 17:41:24.253681 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 522/1017] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:41:24 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:41:25.265356 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b3253ce0-8393-44ff-a510-65f28681977d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:25.267492 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b3253ce0-8393-44ff-a510-65f28681977d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:25.273830 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3253ce0-8393-44ff-a510-65f28681977d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:25.274302 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3253ce0-8393-44ff-a510-65f28681977d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:25.274735 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3253ce0-8393-44ff-a510-65f28681977d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:25.275416 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3253ce0-8393-44ff-a510-65f28681977d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:25.275895 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3253ce0-8393-44ff-a510-65f28681977d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:25.276320 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b3253ce0-8393-44ff-a510-65f28681977d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:25.305293 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b3253ce0-8393-44ff-a510-65f28681977d tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043908 Oct 27 17:41:25.305833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 496/1018] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:41:25 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:26.318256 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8a50a5b9-6141-494c-b815-bf5aa2f49762 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:26.320421 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8a50a5b9-6141-494c-b815-bf5aa2f49762 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:26.327392 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a50a5b9-6141-494c-b815-bf5aa2f49762 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:26.327910 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a50a5b9-6141-494c-b815-bf5aa2f49762 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:26.328349 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a50a5b9-6141-494c-b815-bf5aa2f49762 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:26.329033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a50a5b9-6141-494c-b815-bf5aa2f49762 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:26.329484 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a50a5b9-6141-494c-b815-bf5aa2f49762 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:26.329905 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8a50a5b9-6141-494c-b815-bf5aa2f49762 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:26.358716 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8a50a5b9-6141-494c-b815-bf5aa2f49762 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044485 Oct 27 17:41:26.359254 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 523/1019] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:41:26 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:27.371289 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e1ad00be-df53-48ac-b402-819bc8561b99 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:27.373439 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e1ad00be-df53-48ac-b402-819bc8561b99 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:27.379909 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1ad00be-df53-48ac-b402-819bc8561b99 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:27.380397 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1ad00be-df53-48ac-b402-819bc8561b99 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:27.380828 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1ad00be-df53-48ac-b402-819bc8561b99 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:27.381514 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1ad00be-df53-48ac-b402-819bc8561b99 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:27.381962 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1ad00be-df53-48ac-b402-819bc8561b99 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:27.382380 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1ad00be-df53-48ac-b402-819bc8561b99 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:27.412571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e1ad00be-df53-48ac-b402-819bc8561b99 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045755 Oct 27 17:41:27.413265 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 497/1020] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:41:27 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:28.425394 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0683bcf2-ef9b-4624-95d3-cc60862ff1cd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:28.427608 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-0683bcf2-ef9b-4624-95d3-cc60862ff1cd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:28.434530 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0683bcf2-ef9b-4624-95d3-cc60862ff1cd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:28.435005 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0683bcf2-ef9b-4624-95d3-cc60862ff1cd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:28.435436 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0683bcf2-ef9b-4624-95d3-cc60862ff1cd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:28.436155 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0683bcf2-ef9b-4624-95d3-cc60862ff1cd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:28.436610 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0683bcf2-ef9b-4624-95d3-cc60862ff1cd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:28.437035 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0683bcf2-ef9b-4624-95d3-cc60862ff1cd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:28.465620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0683bcf2-ef9b-4624-95d3-cc60862ff1cd tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044320 Oct 27 17:41:28.466165 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 524/1021] 10.222.0.36 () {58 vars in 1302 bytes} [Thu Oct 27 17:41:28 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 17:41:28.528776 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6167704c-0d65-4c36-bd09-435d843ff686 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:28.529285 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6167704c-0d65-4c36-bd09-435d843ff686 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:28.535522 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6167704c-0d65-4c36-bd09-435d843ff686 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:28.536028 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6167704c-0d65-4c36-bd09-435d843ff686 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:28.536478 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6167704c-0d65-4c36-bd09-435d843ff686 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:28.537162 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6167704c-0d65-4c36-bd09-435d843ff686 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:28.537612 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6167704c-0d65-4c36-bd09-435d843ff686 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:28.538035 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6167704c-0d65-4c36-bd09-435d843ff686 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:28.563326 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6167704c-0d65-4c36-bd09-435d843ff686 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Going to try to terminate instance {{(pid=119046) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:41:28.636606 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6167704c-0d65-4c36-bd09-435d843ff686 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "DELETE /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 204 len: 0 microversion: 2.1 time: 0.111854 Oct 27 17:41:28.637189 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 498/1022] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:41:28 2022] DELETE /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:41:28.646648 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d6ee6dc9-18bc-4342-bfaa-d57fdbbafa28 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:28.647421 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d6ee6dc9-18bc-4342-bfaa-d57fdbbafa28 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:28.653836 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d6ee6dc9-18bc-4342-bfaa-d57fdbbafa28 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:28.654310 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d6ee6dc9-18bc-4342-bfaa-d57fdbbafa28 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:28.654739 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d6ee6dc9-18bc-4342-bfaa-d57fdbbafa28 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:28.655416 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d6ee6dc9-18bc-4342-bfaa-d57fdbbafa28 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:28.655925 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d6ee6dc9-18bc-4342-bfaa-d57fdbbafa28 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:28.656348 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d6ee6dc9-18bc-4342-bfaa-d57fdbbafa28 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:28.784737 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d6ee6dc9-18bc-4342-bfaa-d57fdbbafa28 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:41:28.793000 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d6ee6dc9-18bc-4342-bfaa-d57fdbbafa28 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 200 len: 1683 microversion: 2.1 time: 0.151251 Oct 27 17:41:28.793559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 525/1023] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:41:28 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:41:29.816436 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-bdfb4c5a-5883-4cc4-80c4-e7aa212ffb1e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:29.817130 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-bdfb4c5a-5883-4cc4-80c4-e7aa212ffb1e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:29.823451 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bdfb4c5a-5883-4cc4-80c4-e7aa212ffb1e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:29.823972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bdfb4c5a-5883-4cc4-80c4-e7aa212ffb1e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:29.824403 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bdfb4c5a-5883-4cc4-80c4-e7aa212ffb1e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:29.825077 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bdfb4c5a-5883-4cc4-80c4-e7aa212ffb1e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:29.825517 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bdfb4c5a-5883-4cc4-80c4-e7aa212ffb1e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:29.825932 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-bdfb4c5a-5883-4cc4-80c4-e7aa212ffb1e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:29.959141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-bdfb4c5a-5883-4cc4-80c4-e7aa212ffb1e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:41:29.967269 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-bdfb4c5a-5883-4cc4-80c4-e7aa212ffb1e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 200 len: 1683 microversion: 2.1 time: 0.154993 Oct 27 17:41:29.967844 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 499/1024] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:41:29 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:41:30.991697 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2881bbf2-81d2-4a86-8bf2-7585ec0511ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:30.992495 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2881bbf2-81d2-4a86-8bf2-7585ec0511ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:30.999551 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2881bbf2-81d2-4a86-8bf2-7585ec0511ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:31.000145 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2881bbf2-81d2-4a86-8bf2-7585ec0511ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:31.000652 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2881bbf2-81d2-4a86-8bf2-7585ec0511ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:31.001425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2881bbf2-81d2-4a86-8bf2-7585ec0511ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:31.001954 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2881bbf2-81d2-4a86-8bf2-7585ec0511ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:31.002386 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2881bbf2-81d2-4a86-8bf2-7585ec0511ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:31.140067 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2881bbf2-81d2-4a86-8bf2-7585ec0511ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:41:31.147832 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2881bbf2-81d2-4a86-8bf2-7585ec0511ce tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 200 len: 1683 microversion: 2.1 time: 0.160099 Oct 27 17:41:31.148454 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 526/1025] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:41:30 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:41:31.725374 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-4e0ff318-47f9-445b-b002-45f7f9182346 req-d38d3ec3-6e5d-4940-91ce-944e3ac03b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df713ea3-3864-4216-8d98-2d008ac2baab", "name": "network-vif-deleted", "tag": "48cf2b20-7d7f-4936-b226-396b5f7eae33"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:41:31.737357 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-4e0ff318-47f9-445b-b002-45f7f9182346 req-d38d3ec3-6e5d-4940-91ce-944e3ac03b5f service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:31.737950 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-4e0ff318-47f9-445b-b002-45f7f9182346 req-d38d3ec3-6e5d-4940-91ce-944e3ac03b5f service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:31.738570 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-4e0ff318-47f9-445b-b002-45f7f9182346 req-d38d3ec3-6e5d-4940-91ce-944e3ac03b5f service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:31.750862 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-4e0ff318-47f9-445b-b002-45f7f9182346 req-d38d3ec3-6e5d-4940-91ce-944e3ac03b5f service nova] Creating event network-vif-deleted:48cf2b20-7d7f-4936-b226-396b5f7eae33 for instance df713ea3-3864-4216-8d98-2d008ac2baab on hv-cinder-86283 Oct 27 17:41:31.757078 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-4e0ff318-47f9-445b-b002-45f7f9182346 req-d38d3ec3-6e5d-4940-91ce-944e3ac03b5f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035401 Oct 27 17:41:31.758088 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 500/1026] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:32.174186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-dd73b156-a089-4055-af23-a83c61937ff8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:32.175528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-dd73b156-a089-4055-af23-a83c61937ff8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:32.183374 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd73b156-a089-4055-af23-a83c61937ff8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:32.184046 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd73b156-a089-4055-af23-a83c61937ff8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:32.185186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd73b156-a089-4055-af23-a83c61937ff8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:32.186362 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd73b156-a089-4055-af23-a83c61937ff8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:32.187030 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd73b156-a089-4055-af23-a83c61937ff8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:32.187935 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd73b156-a089-4055-af23-a83c61937ff8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:32.228989 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd73b156-a089-4055-af23-a83c61937ff8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:32.229719 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd73b156-a089-4055-af23-a83c61937ff8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:32.230489 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-dd73b156-a089-4055-af23-a83c61937ff8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:32.231042 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.objects.instance [None req-dd73b156-a089-4055-af23-a83c61937ff8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lazy-loading 'fault' on Instance uuid df713ea3-3864-4216-8d98-2d008ac2baab {{(pid=119047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:41:32.323098 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-dd73b156-a089-4055-af23-a83c61937ff8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c36ea3a53cc48fa996891e3c6ddfda8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35c2b53ccb445d4b0dd2915376f69cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:41:32.332489 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-dd73b156-a089-4055-af23-a83c61937ff8 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 200 len: 1331 microversion: 2.1 time: 0.164284 Oct 27 17:41:32.344446 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 527/1027] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:41:32 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 1331 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:41:33.357962 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-16989893-1f50-46f5-92c9-4fb7ebb62597 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:33.358652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-16989893-1f50-46f5-92c9-4fb7ebb62597 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:33.366343 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-16989893-1f50-46f5-92c9-4fb7ebb62597 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:33.367026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-16989893-1f50-46f5-92c9-4fb7ebb62597 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:33.367457 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-16989893-1f50-46f5-92c9-4fb7ebb62597 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:33.368181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-16989893-1f50-46f5-92c9-4fb7ebb62597 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:33.369181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-16989893-1f50-46f5-92c9-4fb7ebb62597 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:33.369603 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-16989893-1f50-46f5-92c9-4fb7ebb62597 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:33.382746 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-16989893-1f50-46f5-92c9-4fb7ebb62597 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] HTTP exception thrown: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-16989893-1f50-46f5-92c9-4fb7ebb62597 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Request method failure captured: Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab HTTP/1.1 Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA48P867QnVFetJM_7-4A7Zzy1y_BgK92PPcM5QN2sMM7rFRhLUgPfG-i71JivsPG4LadkJJ4XcZlaVkMTt9ACmFBCVr55uoiFNCoOee5ZYSDumbUSBNjRpORNBa4HVT1DYjC6OvQXdJDtZsCkYaDUqFgRE6zbJPygnGePlokMgMzQ Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:41:33.384432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:41:33.386051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}] Oct 27 17:41:33.386051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:33.386051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:33.386051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:33.386051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:33.386051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:41:33.386051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:41:33.386051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 3c36ea3a53cc48fa996891e3c6ddfda8 Oct 27 17:41:33.386051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:33.386051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:41:33.386051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. Oct 27 17:41:33.386051 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': 'df713ea3-3864-4216-8d98-2d008ac2baab'} Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:41:33.386980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. Oct 27 17:41:33.388426 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:33.390772 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-16989893-1f50-46f5-92c9-4fb7ebb62597 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Returning 404 to user: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:41:33.390772 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-16989893-1f50-46f5-92c9-4fb7ebb62597 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 404 len: 111 microversion: 2.1 time: 0.033418 Oct 27 17:41:33.390772 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 501/1028] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:41:33 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:41:33.394624 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-60479a39-a198-4e80-ab51-a0c4dde48593 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '.version_select at 0x7f0788674e50>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:33.413118 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-60479a39-a198-4e80-ab51-a0c4dde48593 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1618499157" status: 202 len: 0 microversion: 2.1 time: 0.022276 Oct 27 17:41:33.413692 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 528/1029] 10.222.0.36 () {58 vars in 1221 bytes} [Thu Oct 27 17:41:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1618499157 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:41:35.195630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7484a102-2504-47f2-a687-65c5ec0b3d54 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:35.196142 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7484a102-2504-47f2-a687-65c5ec0b3d54 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:35.203809 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7484a102-2504-47f2-a687-65c5ec0b3d54 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:35.204291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7484a102-2504-47f2-a687-65c5ec0b3d54 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:35.204731 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7484a102-2504-47f2-a687-65c5ec0b3d54 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:35.205422 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7484a102-2504-47f2-a687-65c5ec0b3d54 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:35.205877 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7484a102-2504-47f2-a687-65c5ec0b3d54 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:35.206298 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7484a102-2504-47f2-a687-65c5ec0b3d54 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:35.220688 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-7484a102-2504-47f2-a687-65c5ec0b3d54 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] HTTP exception thrown: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7484a102-2504-47f2-a687-65c5ec0b3d54 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Request method failure captured: Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: DELETE /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab HTTP/1.1 Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA48P867QnVFetJM_7-4A7Zzy1y_BgK92PPcM5QN2sMM7rFRhLUgPfG-i71JivsPG4LadkJJ4XcZlaVkMTt9ACmFBCVr55uoiFNCoOee5ZYSDumbUSBNjRpORNBa4HVT1DYjC6OvQXdJDtZsCkYaDUqFgRE6zbJPygnGePlokMgMzQ Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:41:35.222245 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:41:35.223872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}] Oct 27 17:41:35.223872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:35.223872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:35.223872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:35.223872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:35.223872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:41:35.223872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:41:35.223872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 3c36ea3a53cc48fa996891e3c6ddfda8 Oct 27 17:41:35.223872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:35.223872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:41:35.223872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. Oct 27 17:41:35.223872 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': 'df713ea3-3864-4216-8d98-2d008ac2baab'} Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:41:35.225395 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. Oct 27 17:41:35.227551 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:35.229148 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7484a102-2504-47f2-a687-65c5ec0b3d54 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Returning 404 to user: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:41:35.229148 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7484a102-2504-47f2-a687-65c5ec0b3d54 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "DELETE /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 404 len: 111 microversion: 2.1 time: 0.031883 Oct 27 17:41:35.229148 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 502/1030] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:41:35 2022] DELETE /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:41:35.233624 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f4909ff3-b195-46ff-a4af-243db21bcfa5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:35.234501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f4909ff3-b195-46ff-a4af-243db21bcfa5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: df713ea3-3864-4216-8d98-2d008ac2baab] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:35.244750 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4909ff3-b195-46ff-a4af-243db21bcfa5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:35.245285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4909ff3-b195-46ff-a4af-243db21bcfa5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:35.245666 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4909ff3-b195-46ff-a4af-243db21bcfa5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:35.246422 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4909ff3-b195-46ff-a4af-243db21bcfa5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:35.246787 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4909ff3-b195-46ff-a4af-243db21bcfa5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:35.247203 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4909ff3-b195-46ff-a4af-243db21bcfa5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:35.263084 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-f4909ff3-b195-46ff-a4af-243db21bcfa5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] HTTP exception thrown: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f4909ff3-b195-46ff-a4af-243db21bcfa5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Request method failure captured: Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab HTTP/1.1 Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA48P867QnVFetJM_7-4A7Zzy1y_BgK92PPcM5QN2sMM7rFRhLUgPfG-i71JivsPG4LadkJJ4XcZlaVkMTt9ACmFBCVr55uoiFNCoOee5ZYSDumbUSBNjRpORNBa4HVT1DYjC6OvQXdJDtZsCkYaDUqFgRE6zbJPygnGePlokMgMzQ Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:41:35.264788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:41:35.266354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}] Oct 27 17:41:35.266354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:35.266354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:35.266354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:35.266354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:35.266354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:41:35.266354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:41:35.266354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 3c36ea3a53cc48fa996891e3c6ddfda8 Oct 27 17:41:35.266354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:35.266354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:41:35.266354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. Oct 27 17:41:35.266354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': 'df713ea3-3864-4216-8d98-2d008ac2baab'} Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:41:35.267243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. Oct 27 17:41:35.268805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:35.270985 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f4909ff3-b195-46ff-a4af-243db21bcfa5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Returning 404 to user: Instance df713ea3-3864-4216-8d98-2d008ac2baab could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:41:35.271843 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f4909ff3-b195-46ff-a4af-243db21bcfa5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab" status: 404 len: 111 microversion: 2.1 time: 0.042590 Oct 27 17:41:35.272391 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 529/1031] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:41:35 2022] GET /compute/v2.1/servers/df713ea3-3864-4216-8d98-2d008ac2baab => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:41:36.416459 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-656be207-f45f-4440-98f5-8d23b2d898e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:36.417003 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-656be207-f45f-4440-98f5-8d23b2d898e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:36.423513 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-656be207-f45f-4440-98f5-8d23b2d898e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:36.424027 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-656be207-f45f-4440-98f5-8d23b2d898e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:36.424463 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-656be207-f45f-4440-98f5-8d23b2d898e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:36.425164 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-656be207-f45f-4440-98f5-8d23b2d898e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:36.425626 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-656be207-f45f-4440-98f5-8d23b2d898e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:36.426519 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-656be207-f45f-4440-98f5-8d23b2d898e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:36.443223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-656be207-f45f-4440-98f5-8d23b2d898e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] HTTP exception thrown: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-656be207-f45f-4440-98f5-8d23b2d898e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Request method failure captured: Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: DELETE /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 HTTP/1.1 Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA48P867QnVFetJM_7-4A7Zzy1y_BgK92PPcM5QN2sMM7rFRhLUgPfG-i71JivsPG4LadkJJ4XcZlaVkMTt9ACmFBCVr55uoiFNCoOee5ZYSDumbUSBNjRpORNBa4HVT1DYjC6OvQXdJDtZsCkYaDUqFgRE6zbJPygnGePlokMgMzQ Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:41:36.445383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:41:36.446986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}] Oct 27 17:41:36.446986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:36.446986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:36.446986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:36.446986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:36.446986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:41:36.446986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:41:36.446986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 3c36ea3a53cc48fa996891e3c6ddfda8 Oct 27 17:41:36.446986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:36.446986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:41:36.446986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. Oct 27 17:41:36.446986 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': 'be393ea8-0e26-4c60-8b50-bab24362d246'} Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:41:36.447917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. Oct 27 17:41:36.449319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.450873 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-656be207-f45f-4440-98f5-8d23b2d898e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Returning 404 to user: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:41:36.450873 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-656be207-f45f-4440-98f5-8d23b2d898e3 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "DELETE /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 404 len: 111 microversion: 2.1 time: 0.035740 Oct 27 17:41:36.450873 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 503/1032] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:41:36 2022] DELETE /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:41:36.457341 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d269ef28-1fd5-45ec-9a44-069050f39540 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:36.458613 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d269ef28-1fd5-45ec-9a44-069050f39540 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: be393ea8-0e26-4c60-8b50-bab24362d246] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:36.465533 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d269ef28-1fd5-45ec-9a44-069050f39540 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:36.466022 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d269ef28-1fd5-45ec-9a44-069050f39540 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:36.466602 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d269ef28-1fd5-45ec-9a44-069050f39540 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:36.467668 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d269ef28-1fd5-45ec-9a44-069050f39540 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:36.468204 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d269ef28-1fd5-45ec-9a44-069050f39540 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:36.468626 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d269ef28-1fd5-45ec-9a44-069050f39540 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:36.483966 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-d269ef28-1fd5-45ec-9a44-069050f39540 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] HTTP exception thrown: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d269ef28-1fd5-45ec-9a44-069050f39540 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Request method failure captured: Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 HTTP/1.1 Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA48P867QnVFetJM_7-4A7Zzy1y_BgK92PPcM5QN2sMM7rFRhLUgPfG-i71JivsPG4LadkJJ4XcZlaVkMTt9ACmFBCVr55uoiFNCoOee5ZYSDumbUSBNjRpORNBa4HVT1DYjC6OvQXdJDtZsCkYaDUqFgRE6zbJPygnGePlokMgMzQ Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:41:36.485515 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:41:36.486802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}] Oct 27 17:41:36.486802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:36.486802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:36.486802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:36.486802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:36.486802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:41:36.486802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:41:36.486802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 3c36ea3a53cc48fa996891e3c6ddfda8 Oct 27 17:41:36.486802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:36.486802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:41:36.486802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. Oct 27 17:41:36.486802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': 'be393ea8-0e26-4c60-8b50-bab24362d246'} Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:41:36.487791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. Oct 27 17:41:36.489227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.490547 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d269ef28-1fd5-45ec-9a44-069050f39540 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Returning 404 to user: Instance be393ea8-0e26-4c60-8b50-bab24362d246 could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:41:36.490547 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d269ef28-1fd5-45ec-9a44-069050f39540 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246" status: 404 len: 111 microversion: 2.1 time: 0.034102 Oct 27 17:41:36.490547 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 530/1033] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:41:36 2022] GET /compute/v2.1/servers/be393ea8-0e26-4c60-8b50-bab24362d246 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:41:36.496283 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-12dd1cb1-3716-426e-974e-3e36149f265e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:36.496787 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-12dd1cb1-3716-426e-974e-3e36149f265e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:36.502646 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-12dd1cb1-3716-426e-974e-3e36149f265e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:36.503127 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-12dd1cb1-3716-426e-974e-3e36149f265e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:36.503556 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-12dd1cb1-3716-426e-974e-3e36149f265e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:36.504459 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-12dd1cb1-3716-426e-974e-3e36149f265e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:36.504921 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-12dd1cb1-3716-426e-974e-3e36149f265e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:36.505341 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-12dd1cb1-3716-426e-974e-3e36149f265e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:36.519062 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-12dd1cb1-3716-426e-974e-3e36149f265e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] HTTP exception thrown: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-12dd1cb1-3716-426e-974e-3e36149f265e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Request method failure captured: Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: DELETE /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a HTTP/1.1 Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA48P867QnVFetJM_7-4A7Zzy1y_BgK92PPcM5QN2sMM7rFRhLUgPfG-i71JivsPG4LadkJJ4XcZlaVkMTt9ACmFBCVr55uoiFNCoOee5ZYSDumbUSBNjRpORNBa4HVT1DYjC6OvQXdJDtZsCkYaDUqFgRE6zbJPygnGePlokMgMzQ Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:41:36.520668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:41:36.522196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}] Oct 27 17:41:36.522196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:36.522196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:36.522196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:36.522196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:36.522196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:41:36.522196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:41:36.522196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 3c36ea3a53cc48fa996891e3c6ddfda8 Oct 27 17:41:36.522196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:36.522196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:41:36.522196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. Oct 27 17:41:36.522196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '50b532a6-30c9-44d5-b680-2e6bc6b2c41a'} Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:41:36.523109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. Oct 27 17:41:36.524864 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.526296 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-12dd1cb1-3716-426e-974e-3e36149f265e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Returning 404 to user: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:41:36.526296 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-12dd1cb1-3716-426e-974e-3e36149f265e tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "DELETE /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 404 len: 111 microversion: 2.1 time: 0.030406 Oct 27 17:41:36.526296 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 504/1034] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:41:36 2022] DELETE /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:41:36.534664 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6349356e-77bd-4157-b5ac-f36527a49156 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:36.535215 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-6349356e-77bd-4157-b5ac-f36527a49156 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 50b532a6-30c9-44d5-b680-2e6bc6b2c41a] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:36.542128 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6349356e-77bd-4157-b5ac-f36527a49156 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:36.542608 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6349356e-77bd-4157-b5ac-f36527a49156 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:36.543046 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6349356e-77bd-4157-b5ac-f36527a49156 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:36.543758 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6349356e-77bd-4157-b5ac-f36527a49156 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:36.544216 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6349356e-77bd-4157-b5ac-f36527a49156 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:36.544640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6349356e-77bd-4157-b5ac-f36527a49156 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:36.558994 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-6349356e-77bd-4157-b5ac-f36527a49156 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] HTTP exception thrown: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6349356e-77bd-4157-b5ac-f36527a49156 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Request method failure captured: Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a HTTP/1.1 Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA48P867QnVFetJM_7-4A7Zzy1y_BgK92PPcM5QN2sMM7rFRhLUgPfG-i71JivsPG4LadkJJ4XcZlaVkMTt9ACmFBCVr55uoiFNCoOee5ZYSDumbUSBNjRpORNBa4HVT1DYjC6OvQXdJDtZsCkYaDUqFgRE6zbJPygnGePlokMgMzQ Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:41:36.560567 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:41:36.562033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}] Oct 27 17:41:36.562033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:36.562033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:36.562033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:36.562033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:36.562033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:41:36.562033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:41:36.562033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 3c36ea3a53cc48fa996891e3c6ddfda8 Oct 27 17:41:36.562033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:36.562033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:41:36.562033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. Oct 27 17:41:36.562033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': '50b532a6-30c9-44d5-b680-2e6bc6b2c41a'} Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:41:36.562796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. Oct 27 17:41:36.564039 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:36.565190 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6349356e-77bd-4157-b5ac-f36527a49156 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Returning 404 to user: Instance 50b532a6-30c9-44d5-b680-2e6bc6b2c41a could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:41:36.565190 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6349356e-77bd-4157-b5ac-f36527a49156 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a" status: 404 len: 111 microversion: 2.1 time: 0.031325 Oct 27 17:41:36.566255 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 531/1035] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:41:36 2022] GET /compute/v2.1/servers/50b532a6-30c9-44d5-b680-2e6bc6b2c41a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:41:37.708076 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-21b373f8-1047-46ec-bfdc-87eba12cb19b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:37.708628 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-21b373f8-1047-46ec-bfdc-87eba12cb19b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:37.714954 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-21b373f8-1047-46ec-bfdc-87eba12cb19b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:37.715411 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-21b373f8-1047-46ec-bfdc-87eba12cb19b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:37.715883 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-21b373f8-1047-46ec-bfdc-87eba12cb19b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:37.716573 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-21b373f8-1047-46ec-bfdc-87eba12cb19b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:37.717025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-21b373f8-1047-46ec-bfdc-87eba12cb19b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:37.717445 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-21b373f8-1047-46ec-bfdc-87eba12cb19b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:37.732893 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-21b373f8-1047-46ec-bfdc-87eba12cb19b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] HTTP exception thrown: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-21b373f8-1047-46ec-bfdc-87eba12cb19b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Request method failure captured: Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: DELETE /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 HTTP/1.1 Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA48P867QnVFetJM_7-4A7Zzy1y_BgK92PPcM5QN2sMM7rFRhLUgPfG-i71JivsPG4LadkJJ4XcZlaVkMTt9ACmFBCVr55uoiFNCoOee5ZYSDumbUSBNjRpORNBa4HVT1DYjC6OvQXdJDtZsCkYaDUqFgRE6zbJPygnGePlokMgMzQ Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:41:37.734464 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:41:37.736073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}] Oct 27 17:41:37.736073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:37.736073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:37.736073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:37.736073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:37.736073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:41:37.736073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:41:37.736073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 3c36ea3a53cc48fa996891e3c6ddfda8 Oct 27 17:41:37.736073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:37.736073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:41:37.736073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. Oct 27 17:41:37.736073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '13686e3e-dfd4-4f2e-9781-92321ff85702'} Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:41:37.737223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. Oct 27 17:41:37.738605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:37.740401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-21b373f8-1047-46ec-bfdc-87eba12cb19b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Returning 404 to user: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:41:37.740401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-21b373f8-1047-46ec-bfdc-87eba12cb19b tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "DELETE /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 404 len: 111 microversion: 2.1 time: 0.031567 Oct 27 17:41:37.740401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 505/1036] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:41:37 2022] DELETE /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:41:37.745038 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-3738690c-480e-4235-8c60-c750026d1ad5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:37.745818 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-3738690c-480e-4235-8c60-c750026d1ad5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] [instance: 13686e3e-dfd4-4f2e-9781-92321ff85702] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:37.752502 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3738690c-480e-4235-8c60-c750026d1ad5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:37.752979 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3738690c-480e-4235-8c60-c750026d1ad5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:37.753407 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3738690c-480e-4235-8c60-c750026d1ad5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:37.754093 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3738690c-480e-4235-8c60-c750026d1ad5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:37.754543 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3738690c-480e-4235-8c60-c750026d1ad5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:37.754960 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3738690c-480e-4235-8c60-c750026d1ad5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:37.768889 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-3738690c-480e-4235-8c60-c750026d1ad5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] HTTP exception thrown: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-3738690c-480e-4235-8c60-c750026d1ad5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Request method failure captured: Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 HTTP/1.1 Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA48P867QnVFetJM_7-4A7Zzy1y_BgK92PPcM5QN2sMM7rFRhLUgPfG-i71JivsPG4LadkJJ4XcZlaVkMTt9ACmFBCVr55uoiFNCoOee5ZYSDumbUSBNjRpORNBa4HVT1DYjC6OvQXdJDtZsCkYaDUqFgRE6zbJPygnGePlokMgMzQ Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:41:37.770413 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:41:37.771988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a35c2b53ccb445d4b0dd2915376f69cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a35c2b53ccb445d4b0dd2915376f69cf"}]}] Oct 27 17:41:37.771988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:37.771988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: a35c2b53ccb445d4b0dd2915376f69cf Oct 27 17:41:37.771988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1620540979 Oct 27 17:41:37.771988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:37.771988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:41:37.771988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:41:37.771988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 3c36ea3a53cc48fa996891e3c6ddfda8 Oct 27 17:41:37.771988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-AttachVolumeNegativeTest-1620540979-project Oct 27 17:41:37.771988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:41:37.771988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. Oct 27 17:41:37.771988 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': '13686e3e-dfd4-4f2e-9781-92321ff85702'} Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:41:37.773028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. Oct 27 17:41:37.774461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:37.775789 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-3738690c-480e-4235-8c60-c750026d1ad5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] Returning 404 to user: Instance 13686e3e-dfd4-4f2e-9781-92321ff85702 could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:41:37.775789 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-3738690c-480e-4235-8c60-c750026d1ad5 tempest-AttachVolumeNegativeTest-1620540979 tempest-AttachVolumeNegativeTest-1620540979-project] 10.222.0.36 "GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702" status: 404 len: 111 microversion: 2.1 time: 0.031105 Oct 27 17:41:37.775789 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 532/1037] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:41:37 2022] GET /compute/v2.1/servers/13686e3e-dfd4-4f2e-9781-92321ff85702 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:41:38.419199 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-c5be6bf6-0da6-43c8-95b4-c7a5e8926ecf tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:38.421407 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c5be6bf6-0da6-43c8-95b4-c7a5e8926ecf tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:38.427287 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c5be6bf6-0da6-43c8-95b4-c7a5e8926ecf tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:38.427797 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c5be6bf6-0da6-43c8-95b4-c7a5e8926ecf tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:38.428234 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c5be6bf6-0da6-43c8-95b4-c7a5e8926ecf tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:38.428918 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c5be6bf6-0da6-43c8-95b4-c7a5e8926ecf tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:38.429372 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c5be6bf6-0da6-43c8-95b4-c7a5e8926ecf tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:38.429796 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c5be6bf6-0da6-43c8-95b4-c7a5e8926ecf tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:38.458493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-c5be6bf6-0da6-43c8-95b4-c7a5e8926ecf tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043982 Oct 27 17:41:38.459067 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 506/1038] 10.222.0.36 () {60 vars in 1343 bytes} [Thu Oct 27 17:41:38 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:41:38.522291 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-06929837-2bfb-4c6b-b4f2-ba5fee824d2d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:38.522784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-06929837-2bfb-4c6b-b4f2-ba5fee824d2d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:38.529180 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-06929837-2bfb-4c6b-b4f2-ba5fee824d2d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:38.529662 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-06929837-2bfb-4c6b-b4f2-ba5fee824d2d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:38.530096 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-06929837-2bfb-4c6b-b4f2-ba5fee824d2d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:38.530786 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-06929837-2bfb-4c6b-b4f2-ba5fee824d2d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:38.531237 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-06929837-2bfb-4c6b-b4f2-ba5fee824d2d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:38.531659 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-06929837-2bfb-4c6b-b4f2-ba5fee824d2d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:38.560646 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-06929837-2bfb-4c6b-b4f2-ba5fee824d2d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Going to try to terminate instance {{(pid=119047) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:41:38.638927 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-06929837-2bfb-4c6b-b4f2-ba5fee824d2d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 204 len: 0 microversion: 2.20 time: 0.119964 Oct 27 17:41:38.639523 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 533/1039] 10.222.0.36 () {60 vars in 1280 bytes} [Thu Oct 27 17:41:38 2022] DELETE /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 17:41:38.648203 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-1f991be5-f931-41e8-8eb6-4f0521a0b3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:38.648805 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-1f991be5-f931-41e8-8eb6-4f0521a0b3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:38.655117 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f991be5-f931-41e8-8eb6-4f0521a0b3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:38.655595 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f991be5-f931-41e8-8eb6-4f0521a0b3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:38.656066 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f991be5-f931-41e8-8eb6-4f0521a0b3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:38.656748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f991be5-f931-41e8-8eb6-4f0521a0b3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:38.657191 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f991be5-f931-41e8-8eb6-4f0521a0b3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:38.657609 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f991be5-f931-41e8-8eb6-4f0521a0b3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:38.857471 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1f991be5-f931-41e8-8eb6-4f0521a0b3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:41:38.870741 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1f991be5-f931-41e8-8eb6-4f0521a0b3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:41:38.872524 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1f991be5-f931-41e8-8eb6-4f0521a0b3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:41:38.873707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-1f991be5-f931-41e8-8eb6-4f0521a0b3bd tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1723 microversion: 2.20 time: 0.229700 Oct 27 17:41:38.874263 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 507/1040] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:41:38 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:41:39.899004 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-e0ae2702-7574-4a17-b9c0-80c13fa1a640 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:39.899816 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e0ae2702-7574-4a17-b9c0-80c13fa1a640 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:39.905909 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e0ae2702-7574-4a17-b9c0-80c13fa1a640 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:39.906390 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e0ae2702-7574-4a17-b9c0-80c13fa1a640 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:39.906824 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e0ae2702-7574-4a17-b9c0-80c13fa1a640 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:39.907520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e0ae2702-7574-4a17-b9c0-80c13fa1a640 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:39.911170 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e0ae2702-7574-4a17-b9c0-80c13fa1a640 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:39.914825 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-e0ae2702-7574-4a17-b9c0-80c13fa1a640 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:40.167848 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e0ae2702-7574-4a17-b9c0-80c13fa1a640 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:41:40.176698 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e0ae2702-7574-4a17-b9c0-80c13fa1a640 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:41:40.178282 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e0ae2702-7574-4a17-b9c0-80c13fa1a640 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:41:40.179559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-e0ae2702-7574-4a17-b9c0-80c13fa1a640 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1723 microversion: 2.20 time: 0.284897 Oct 27 17:41:40.180187 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 534/1041] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:41:39 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:41:41.204881 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-567547c9-0ed8-4ade-8856-3f5bef7c5571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:41.205486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-567547c9-0ed8-4ade-8856-3f5bef7c5571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:41.213348 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-567547c9-0ed8-4ade-8856-3f5bef7c5571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:41.213919 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-567547c9-0ed8-4ade-8856-3f5bef7c5571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:41.214564 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-567547c9-0ed8-4ade-8856-3f5bef7c5571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:41.215335 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-567547c9-0ed8-4ade-8856-3f5bef7c5571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:41.215699 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-567547c9-0ed8-4ade-8856-3f5bef7c5571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:41.216335 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-567547c9-0ed8-4ade-8856-3f5bef7c5571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:41.527198 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-567547c9-0ed8-4ade-8856-3f5bef7c5571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:41:41.540058 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-567547c9-0ed8-4ade-8856-3f5bef7c5571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:41:41.541607 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-567547c9-0ed8-4ade-8856-3f5bef7c5571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:41:41.542795 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-567547c9-0ed8-4ade-8856-3f5bef7c5571 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1723 microversion: 2.20 time: 0.341705 Oct 27 17:41:41.543365 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 508/1042] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:41:41 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1723 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:41:42.335291 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-3edada3c-afda-4db0-a28d-3300233c0751 req-226c443f-dbfe-4977-8fab-a6ebf4f832e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef8a04a-8ed9-43bd-8a43-8ed991b5d746", "name": "network-vif-deleted", "tag": "e44c2473-a49a-4e38-91e6-b32e6e8065d8"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:41:42.344998 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-3edada3c-afda-4db0-a28d-3300233c0751 req-226c443f-dbfe-4977-8fab-a6ebf4f832e8 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:42.345948 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-3edada3c-afda-4db0-a28d-3300233c0751 req-226c443f-dbfe-4977-8fab-a6ebf4f832e8 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:42.346539 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-3edada3c-afda-4db0-a28d-3300233c0751 req-226c443f-dbfe-4977-8fab-a6ebf4f832e8 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:42.358576 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-3edada3c-afda-4db0-a28d-3300233c0751 req-226c443f-dbfe-4977-8fab-a6ebf4f832e8 service nova] Creating event network-vif-deleted:e44c2473-a49a-4e38-91e6-b32e6e8065d8 for instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 on hv-cinder-86283 Oct 27 17:41:42.364737 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-3edada3c-afda-4db0-a28d-3300233c0751 req-226c443f-dbfe-4977-8fab-a6ebf4f832e8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.378745 Oct 27 17:41:42.365815 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 535/1043] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:42.572427 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0c07bb17-36f3-410e-9073-ea02febeea0c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:42.578334 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-0c07bb17-36f3-410e-9073-ea02febeea0c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:42.589323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:41:42.592922 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0c07bb17-36f3-410e-9073-ea02febeea0c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:42.593774 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0c07bb17-36f3-410e-9073-ea02febeea0c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:42.594514 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0c07bb17-36f3-410e-9073-ea02febeea0c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:42.595953 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0c07bb17-36f3-410e-9073-ea02febeea0c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:42.596819 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0c07bb17-36f3-410e-9073-ea02febeea0c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:42.597588 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0c07bb17-36f3-410e-9073-ea02febeea0c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:42.608938 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:41:42.673296 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0c07bb17-36f3-410e-9073-ea02febeea0c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:42.674001 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0c07bb17-36f3-410e-9073-ea02febeea0c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:42.674780 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0c07bb17-36f3-410e-9073-ea02febeea0c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:42.676933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-0c07bb17-36f3-410e-9073-ea02febeea0c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lazy-loading 'fault' on Instance uuid bef8a04a-8ed9-43bd-8a43-8ed991b5d746 {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:41:42.752260 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0c07bb17-36f3-410e-9073-ea02febeea0c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:41:42.763703 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0c07bb17-36f3-410e-9073-ea02febeea0c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:41:42.765258 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0c07bb17-36f3-410e-9073-ea02febeea0c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d8ef8bb0fa645048c6389bd1402c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c1b56e78014b57918f3c4b7ed32114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:41:42.766956 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0c07bb17-36f3-410e-9073-ea02febeea0c tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 200 len: 1372 microversion: 2.20 time: 0.199753 Oct 27 17:41:42.768252 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 509/1044] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:41:42 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 17:41:43.795198 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6dd82f8e-4fcc-4664-8cd4-cb72bb41399d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:43.796103 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-6dd82f8e-4fcc-4664-8cd4-cb72bb41399d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:43.802609 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6dd82f8e-4fcc-4664-8cd4-cb72bb41399d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:43.803289 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6dd82f8e-4fcc-4664-8cd4-cb72bb41399d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:43.803761 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6dd82f8e-4fcc-4664-8cd4-cb72bb41399d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:43.804468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6dd82f8e-4fcc-4664-8cd4-cb72bb41399d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:43.805085 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6dd82f8e-4fcc-4664-8cd4-cb72bb41399d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:43.805700 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6dd82f8e-4fcc-4664-8cd4-cb72bb41399d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:43.820244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-6dd82f8e-4fcc-4664-8cd4-cb72bb41399d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] HTTP exception thrown: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6dd82f8e-4fcc-4664-8cd4-cb72bb41399d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Request method failure captured: Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 HTTP/1.1 Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA07JRNIIigKkKj39DZsCXRhadJ6r1jJOY3yUFcvJ0JX0pRLqqjDmQopGzDS3rPQwEvgFBAXlx6x-LnkGlMVsUW7p8s6Lcg-FdtiF9eb2sLSoxpVrmxQPG7i8Kf8un2OnIw0_FdiPJZHvpsLm8bmkoGSYqci7c7CqkXXp-Clpu-258 Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: 48c1b56e78014b57918f3c4b7ed32114 Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:41:43.822882 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:41:43.824588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48c1b56e78014b57918f3c4b7ed32114"}]}] Oct 27 17:41:43.824588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:41:43.824588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: 48c1b56e78014b57918f3c4b7ed32114 Oct 27 17:41:43.824588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:41:43.824588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-AttachVolumeShelveTestJSON-269718429-project Oct 27 17:41:43.824588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:41:43.824588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:41:43.824588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 1d8ef8bb0fa645048c6389bd1402c471 Oct 27 17:41:43.824588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269718429-project Oct 27 17:41:43.824588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:41:43.824588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. Oct 27 17:41:43.824588 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': 'bef8a04a-8ed9-43bd-8a43-8ed991b5d746'} Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:41:43.825418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. Oct 27 17:41:43.826713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:43.831536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6dd82f8e-4fcc-4664-8cd4-cb72bb41399d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Returning 404 to user: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:41:43.831536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6dd82f8e-4fcc-4664-8cd4-cb72bb41399d tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 404 len: 111 microversion: 2.20 time: 0.035162 Oct 27 17:41:43.831536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 536/1045] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:41:43 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 17:41:43.836240 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a54e2fb8-0210-4753-9bec-57c02a30bcea tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '.version_select at 0x7f0788579670>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:43.857761 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a54e2fb8-0210-4753-9bec-57c02a30bcea tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788232169" status: 204 len: 0 microversion: 2.20 time: 0.025317 Oct 27 17:41:43.858699 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 510/1046] 10.222.0.36 () {60 vars in 1262 bytes} [Thu Oct 27 17:41:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788232169 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 17:41:45.719504 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8117383f-38e2-4a2d-bf87-0ee6c3a567d9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:45.720325 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8117383f-38e2-4a2d-bf87-0ee6c3a567d9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:45.723131 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:41:45.729090 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8117383f-38e2-4a2d-bf87-0ee6c3a567d9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:45.729968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8117383f-38e2-4a2d-bf87-0ee6c3a567d9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:45.730416 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8117383f-38e2-4a2d-bf87-0ee6c3a567d9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:45.731109 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8117383f-38e2-4a2d-bf87-0ee6c3a567d9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:45.731562 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8117383f-38e2-4a2d-bf87-0ee6c3a567d9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:45.732086 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8117383f-38e2-4a2d-bf87-0ee6c3a567d9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:45.735557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:41:45.751480 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-8117383f-38e2-4a2d-bf87-0ee6c3a567d9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] HTTP exception thrown: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8117383f-38e2-4a2d-bf87-0ee6c3a567d9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Request method failure captured: Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: DELETE /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 HTTP/1.1 Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA07JRNIIigKkKj39DZsCXRhadJ6r1jJOY3yUFcvJ0JX0pRLqqjDmQopGzDS3rPQwEvgFBAXlx6x-LnkGlMVsUW7p8s6Lcg-FdtiF9eb2sLSoxpVrmxQPG7i8Kf8un2OnIw0_FdiPJZHvpsLm8bmkoGSYqci7c7CqkXXp-Clpu-258 Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: 48c1b56e78014b57918f3c4b7ed32114 Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:41:45.753074 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:41:45.754743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48c1b56e78014b57918f3c4b7ed32114"}]}] Oct 27 17:41:45.754743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:41:45.754743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: 48c1b56e78014b57918f3c4b7ed32114 Oct 27 17:41:45.754743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:41:45.754743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-AttachVolumeShelveTestJSON-269718429-project Oct 27 17:41:45.754743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:41:45.754743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:41:45.754743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 1d8ef8bb0fa645048c6389bd1402c471 Oct 27 17:41:45.754743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269718429-project Oct 27 17:41:45.754743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:41:45.754743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. Oct 27 17:41:45.754743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': 'bef8a04a-8ed9-43bd-8a43-8ed991b5d746'} Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:41:45.755620 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. Oct 27 17:41:45.757356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:45.758894 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8117383f-38e2-4a2d-bf87-0ee6c3a567d9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Returning 404 to user: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:41:45.758894 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8117383f-38e2-4a2d-bf87-0ee6c3a567d9 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 404 len: 111 microversion: 2.20 time: 0.039406 Oct 27 17:41:45.758894 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 537/1047] 10.222.0.36 () {60 vars in 1280 bytes} [Thu Oct 27 17:41:45 2022] DELETE /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 17:41:45.764552 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-61939d15-1049-41b0-a66e-387b61132683 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:45.765173 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-61939d15-1049-41b0-a66e-387b61132683 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: bef8a04a-8ed9-43bd-8a43-8ed991b5d746] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:45.771825 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-61939d15-1049-41b0-a66e-387b61132683 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:45.772315 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-61939d15-1049-41b0-a66e-387b61132683 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:45.772757 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-61939d15-1049-41b0-a66e-387b61132683 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:45.773440 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-61939d15-1049-41b0-a66e-387b61132683 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:45.773889 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-61939d15-1049-41b0-a66e-387b61132683 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:45.774313 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-61939d15-1049-41b0-a66e-387b61132683 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:45.787205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-61939d15-1049-41b0-a66e-387b61132683 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] HTTP exception thrown: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-61939d15-1049-41b0-a66e-387b61132683 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Request method failure captured: Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 HTTP/1.1 Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA07JRNIIigKkKj39DZsCXRhadJ6r1jJOY3yUFcvJ0JX0pRLqqjDmQopGzDS3rPQwEvgFBAXlx6x-LnkGlMVsUW7p8s6Lcg-FdtiF9eb2sLSoxpVrmxQPG7i8Kf8un2OnIw0_FdiPJZHvpsLm8bmkoGSYqci7c7CqkXXp-Clpu-258 Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: 48c1b56e78014b57918f3c4b7ed32114 Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:41:45.788785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:41:45.790496 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48c1b56e78014b57918f3c4b7ed32114"}]}] Oct 27 17:41:45.790496 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:41:45.790496 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: 48c1b56e78014b57918f3c4b7ed32114 Oct 27 17:41:45.790496 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:41:45.790496 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-AttachVolumeShelveTestJSON-269718429-project Oct 27 17:41:45.790496 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:41:45.790496 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:41:45.790496 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 1d8ef8bb0fa645048c6389bd1402c471 Oct 27 17:41:45.790496 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269718429-project Oct 27 17:41:45.790496 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:41:45.790496 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. Oct 27 17:41:45.790496 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': 'bef8a04a-8ed9-43bd-8a43-8ed991b5d746'} Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:41:45.791466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. Oct 27 17:41:45.793026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:45.794409 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-61939d15-1049-41b0-a66e-387b61132683 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Returning 404 to user: Instance bef8a04a-8ed9-43bd-8a43-8ed991b5d746 could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:41:45.794409 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-61939d15-1049-41b0-a66e-387b61132683 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746" status: 404 len: 111 microversion: 2.20 time: 0.030784 Oct 27 17:41:45.794409 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 511/1048] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:41:45 2022] GET /compute/v2.1/servers/bef8a04a-8ed9-43bd-8a43-8ed991b5d746 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 17:41:46.934318 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-bd43329b-47dd-40d8-a1e7-712721877e97 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:46.934953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-bd43329b-47dd-40d8-a1e7-712721877e97 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:46.942351 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bd43329b-47dd-40d8-a1e7-712721877e97 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:46.942787 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bd43329b-47dd-40d8-a1e7-712721877e97 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:46.943213 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bd43329b-47dd-40d8-a1e7-712721877e97 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:46.943932 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bd43329b-47dd-40d8-a1e7-712721877e97 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:46.944380 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bd43329b-47dd-40d8-a1e7-712721877e97 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:46.944798 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-bd43329b-47dd-40d8-a1e7-712721877e97 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:46.960376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-bd43329b-47dd-40d8-a1e7-712721877e97 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] HTTP exception thrown: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-bd43329b-47dd-40d8-a1e7-712721877e97 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Request method failure captured: Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: DELETE /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e HTTP/1.1 Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsA07JRNIIigKkKj39DZsCXRhadJ6r1jJOY3yUFcvJ0JX0pRLqqjDmQopGzDS3rPQwEvgFBAXlx6x-LnkGlMVsUW7p8s6Lcg-FdtiF9eb2sLSoxpVrmxQPG7i8Kf8un2OnIw0_FdiPJZHvpsLm8bmkoGSYqci7c7CqkXXp-Clpu-258 Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: 48c1b56e78014b57918f3c4b7ed32114 Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:41:46.961959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:41:46.964326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48c1b56e78014b57918f3c4b7ed32114"}]}] Oct 27 17:41:46.964326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:41:46.964326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: 48c1b56e78014b57918f3c4b7ed32114 Oct 27 17:41:46.964326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:41:46.964326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-AttachVolumeShelveTestJSON-269718429-project Oct 27 17:41:46.964326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:41:46.964326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:41:46.964326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 1d8ef8bb0fa645048c6389bd1402c471 Oct 27 17:41:46.964326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269718429-project Oct 27 17:41:46.964326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:41:46.964326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. Oct 27 17:41:46.964326 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': '2b27a822-4c22-45f0-872b-67e5f360f45e'} Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:41:46.965234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. Oct 27 17:41:46.966711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:41:46.968155 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-bd43329b-47dd-40d8-a1e7-712721877e97 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Returning 404 to user: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:41:46.968155 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-bd43329b-47dd-40d8-a1e7-712721877e97 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 404 len: 111 microversion: 2.20 time: 0.034024 Oct 27 17:41:46.968155 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 538/1049] 10.222.0.36 () {60 vars in 1280 bytes} [Thu Oct 27 17:41:46 2022] DELETE /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 17:41:46.973311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-66ec522d-1259-4ff7-88be-f8c1719d24e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:46.974183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-66ec522d-1259-4ff7-88be-f8c1719d24e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] [instance: 2b27a822-4c22-45f0-872b-67e5f360f45e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:41:46.980751 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66ec522d-1259-4ff7-88be-f8c1719d24e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:46.981234 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66ec522d-1259-4ff7-88be-f8c1719d24e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:46.981666 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66ec522d-1259-4ff7-88be-f8c1719d24e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:46.982364 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66ec522d-1259-4ff7-88be-f8c1719d24e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:41:46.982812 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66ec522d-1259-4ff7-88be-f8c1719d24e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:41:46.983240 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-66ec522d-1259-4ff7-88be-f8c1719d24e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:41:46.997279 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-66ec522d-1259-4ff7-88be-f8c1719d24e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] HTTP exception thrown: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-66ec522d-1259-4ff7-88be-f8c1719d24e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Request method failure captured: Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e HTTP/1.1 Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsA07JRNIIigKkKj39DZsCXRhadJ6r1jJOY3yUFcvJ0JX0pRLqqjDmQopGzDS3rPQwEvgFBAXlx6x-LnkGlMVsUW7p8s6Lcg-FdtiF9eb2sLSoxpVrmxQPG7i8Kf8un2OnIw0_FdiPJZHvpsLm8bmkoGSYqci7c7CqkXXp-Clpu-258 Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: 48c1b56e78014b57918f3c4b7ed32114 Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:41:46.998833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:41:47.000587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_48c1b56e78014b57918f3c4b7ed32114"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/48c1b56e78014b57918f3c4b7ed32114"}]}] Oct 27 17:41:47.000587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:41:47.000587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: 48c1b56e78014b57918f3c4b7ed32114 Oct 27 17:41:47.000587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-269718429 Oct 27 17:41:47.000587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-AttachVolumeShelveTestJSON-269718429-project Oct 27 17:41:47.000587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:41:47.000587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:41:47.000587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 1d8ef8bb0fa645048c6389bd1402c471 Oct 27 17:41:47.000587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-AttachVolumeShelveTestJSON-269718429-project Oct 27 17:41:47.000587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:41:47.000587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. Oct 27 17:41:47.000587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '2b27a822-4c22-45f0-872b-67e5f360f45e'} Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:41:47.005103 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. Oct 27 17:41:47.007205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:47.008613 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-66ec522d-1259-4ff7-88be-f8c1719d24e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] Returning 404 to user: Instance 2b27a822-4c22-45f0-872b-67e5f360f45e could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:41:47.008613 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-66ec522d-1259-4ff7-88be-f8c1719d24e3 tempest-AttachVolumeShelveTestJSON-269718429 tempest-AttachVolumeShelveTestJSON-269718429-project] 10.222.0.36 "GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e" status: 404 len: 111 microversion: 2.20 time: 0.031114 Oct 27 17:41:47.008613 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 512/1050] 10.222.0.36 () {60 vars in 1277 bytes} [Thu Oct 27 17:41:46 2022] GET /compute/v2.1/servers/2b27a822-4c22-45f0-872b-67e5f360f45e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 17:41:51.716866 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-233d45b1-26b4-4514-a02a-029e15f65ba0 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Action: 'create', calling method: .version_select at 0x7f0788815a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1132517323"}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:41:52.016946 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-233d45b1-26b4-4514-a02a-029e15f65ba0 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.414204 Oct 27 17:41:52.017893 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 539/1051] 10.222.0.36 () {60 vars in 1155 bytes} [Thu Oct 27 17:41:51 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 416 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 17:41:52.031181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-40700bb5-dd37-403f-ad12-5e35d63ac0cd tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f078849e280>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:52.090466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-40700bb5-dd37-403f-ad12-5e35d63ac0cd tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7" status: 200 len: 345 microversion: 2.1 time: 0.063181 Oct 27 17:41:52.091130 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 513/1052] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Oct 27 17:41:52 2022] GET /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:53.105819 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1a4f1b44-f5fa-4718-99db-b06caaa76597 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f07886c7ee0>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:53.156609 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1a4f1b44-f5fa-4718-99db-b06caaa76597 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7" status: 200 len: 346 microversion: 2.1 time: 0.055112 Oct 27 17:41:53.157344 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 540/1053] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Oct 27 17:41:53 2022] GET /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:53.170667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-411fbd98-a8f9-4f05-b2ce-2f111096c7a0 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Action: 'create', calling method: .version_select at 0x7f078858dd30>, body: {"snapshot": {"volume_id": "80b5fe34-e283-48e4-b7b8-3dad79839ec7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-195615719"}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:41:53.361693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-411fbd98-a8f9-4f05-b2ce-2f111096c7a0 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.195175 Oct 27 17:41:53.362306 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 514/1054] 10.222.0.36 () {60 vars in 1162 bytes} [Thu Oct 27 17:41:53 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:53.374892 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-104b3310-605f-49e8-89fa-79117eedd0e5 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f07886be160>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:53.408195 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-104b3310-605f-49e8-89fa-79117eedd0e5 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05" status: 200 len: 286 microversion: 2.1 time: 0.037888 Oct 27 17:41:53.408840 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 541/1055] 10.222.0.36 () {58 vars in 1251 bytes} [Thu Oct 27 17:41:53 2022] GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:53.419833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-5bf36cbd-5788-416f-ae9d-7bf3abecb8f8 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f0788524a60>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:53.453362 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-5bf36cbd-5788-416f-ae9d-7bf3abecb8f8 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037278 Oct 27 17:41:53.453925 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 515/1056] 10.222.0.36 () {58 vars in 1140 bytes} [Thu Oct 27 17:41:53 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:41:53.465271 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-61273108-900c-412f-a2af-ee4f0b0e0f3f tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f078866caf0>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:53.496679 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-61273108-900c-412f-a2af-ee4f0b0e0f3f tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05" status: 200 len: 286 microversion: 2.1 time: 0.035247 Oct 27 17:41:53.497406 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 542/1057] 10.222.0.36 () {58 vars in 1251 bytes} [Thu Oct 27 17:41:53 2022] GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:54.510538 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-205cc73e-e113-4a7f-ac5d-842405fac352 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f0788479f70>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:54.548479 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-205cc73e-e113-4a7f-ac5d-842405fac352 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05" status: 200 len: 286 microversion: 2.1 time: 0.042244 Oct 27 17:41:54.549470 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 516/1058] 10.222.0.36 () {58 vars in 1251 bytes} [Thu Oct 27 17:41:54 2022] GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:55.562600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-231af9f9-619f-495e-b65d-88db2549bab4 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f0788a43af0>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:55.602062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-231af9f9-619f-495e-b65d-88db2549bab4 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05" status: 200 len: 286 microversion: 2.1 time: 0.044185 Oct 27 17:41:55.602706 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 543/1059] 10.222.0.36 () {58 vars in 1251 bytes} [Thu Oct 27 17:41:55 2022] GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:56.618567 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2854871a-cf69-4600-919b-a179e3d39f05 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f07886709d0>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:56.656318 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2854871a-cf69-4600-919b-a179e3d39f05 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05" status: 200 len: 286 microversion: 2.1 time: 0.043949 Oct 27 17:41:56.657091 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 517/1060] 10.222.0.36 () {58 vars in 1251 bytes} [Thu Oct 27 17:41:56 2022] GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:57.667296 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=3 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:41:57.668063 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=3 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:41:57.672896 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-66db6999-fa4f-4bbd-9a84-a5dc9f3911be tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f0788a43790>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:57.704655 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-66db6999-fa4f-4bbd-9a84-a5dc9f3911be tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05" status: 200 len: 287 microversion: 2.1 time: 0.039107 Oct 27 17:41:57.705296 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 544/1061] 10.222.0.36 () {58 vars in 1251 bytes} [Thu Oct 27 17:41:57 2022] GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:57.713713 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:41:57.714454 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=11 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:41:57.719903 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3010f558-dd73-4f43-9384-8be7ab5afc03 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f078849e5e0>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:57.779230 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-3010f558-dd73-4f43-9384-8be7ab5afc03 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05" status: 202 len: 0 microversion: 2.1 time: 0.066546 Oct 27 17:41:57.779827 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 518/1062] 10.222.0.36 () {58 vars in 1254 bytes} [Thu Oct 27 17:41:57 2022] DELETE /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:41:57.788207 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-92d7ef0b-1c44-4251-8455-9abd41bf8e87 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f07889690d0>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:57.820605 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-92d7ef0b-1c44-4251-8455-9abd41bf8e87 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05" status: 200 len: 286 microversion: 2.1 time: 0.036429 Oct 27 17:41:57.821179 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 545/1063] 10.222.0.36 () {58 vars in 1251 bytes} [Thu Oct 27 17:41:57 2022] GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:41:58.834100 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3684fe2d-fa6c-4021-9f67-1623ba9aaa2c tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f0788524dc0>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:58.861077 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-3684fe2d-fa6c-4021-9f67-1623ba9aaa2c tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] HTTP exception thrown: Snapshot 39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 could not be found. Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3684fe2d-fa6c-4021-9f67-1623ba9aaa2c tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Request method failure captured: Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 HTTP/1.1 Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsLfFPSr87zV8_RDpX6Enqkmg200PnkXDiuaiPdkgB-WFIg_N7xIZa_KcUtFvTg4UarQRrEc7UTzyUk0OOeuGFfNgOEZdwYVmGlmwBjWO6LoXP3MFAK4M5vAokQytg6A2AEJiltXYNUg4PDOV0qBNwpDCQpsZqS_-QUjATSGMU3D6IA Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: 36e37b94f6014a08a6523a6418b22ebc Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-720856204 Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:41:58.863886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:41:58.865587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/36e37b94f6014a08a6523a6418b22ebc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/36e37b94f6014a08a6523a6418b22ebc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_36e37b94f6014a08a6523a6418b22ebc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/36e37b94f6014a08a6523a6418b22ebc"}]}] Oct 27 17:41:58.865587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-VolumesSnapshotsTestJSON-720856204 Oct 27 17:41:58.865587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: 36e37b94f6014a08a6523a6418b22ebc Oct 27 17:41:58.865587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-720856204 Oct 27 17:41:58.865587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-VolumesSnapshotsTestJSON-720856204-project Oct 27 17:41:58.865587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:41:58.865587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:41:58.865587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 98e6b82f66dd483c8f63363ab47125ae Oct 27 17:41:58.865587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-VolumesSnapshotsTestJSON-720856204-project Oct 27 17:41:58.865587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: Oct 27 17:41:58.865587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Snapshot 39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 could not be found. Oct 27 17:41:58.865587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05'} Oct 27 17:41:58.865587 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 could not be found. (HTTP 404) (Request-ID: req-39746258-d179-4547-a6f3-f95dc6fa1433) Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:58.866575 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 17:41:58.867964 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 could not be found. Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 27 17:41:58.869286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:41:58.870748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 could not be found. Oct 27 17:41:58.870748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:58.870748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:41:58.870748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:58.870748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:41:58.870748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:41:58.870748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:41:58.870748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:41:58.870748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:41:58.870748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 could not be found. Oct 27 17:41:58.870748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:41:58.870748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3684fe2d-fa6c-4021-9f67-1623ba9aaa2c tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Returning 404 to user: Snapshot 39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:41:58.870748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-3684fe2d-fa6c-4021-9f67-1623ba9aaa2c tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05" status: 404 len: 111 microversion: 2.1 time: 0.036148 Oct 27 17:41:58.871748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 519/1064] 10.222.0.36 () {58 vars in 1251 bytes} [Thu Oct 27 17:41:58 2022] GET /compute/v2.1/os-snapshots/39c9193a-7a6e-4a1a-b3f0-ae24f1f2bc05 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:41:58.874116 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b643cd5b-2ce3-45c7-be22-bcccd0e8b7b1 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f07886c73a0>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:58.933916 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b643cd5b-2ce3-45c7-be22-bcccd0e8b7b1 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7" status: 202 len: 0 microversion: 2.1 time: 0.063470 Oct 27 17:41:58.934485 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 546/1065] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Oct 27 17:41:58 2022] DELETE /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:41:58.943913 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-dbf2ebad-1aa7-4fbe-b58e-6990ad601658 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f078849e5e0>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:41:58.992542 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-dbf2ebad-1aa7-4fbe-b58e-6990ad601658 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7" status: 200 len: 345 microversion: 2.1 time: 0.053580 Oct 27 17:41:58.993141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 520/1066] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Oct 27 17:41:58 2022] GET /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:42:00.007741 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f8a32a80-afe4-4d1b-854b-23a789f0a2f6 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f0788674d30>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:00.038565 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-f8a32a80-afe4-4d1b-854b-23a789f0a2f6 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] HTTP exception thrown: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f8a32a80-afe4-4d1b-854b-23a789f0a2f6 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Request method failure captured: Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7 HTTP/1.1 Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsLfFPSr87zV8_RDpX6Enqkmg200PnkXDiuaiPdkgB-WFIg_N7xIZa_KcUtFvTg4UarQRrEc7UTzyUk0OOeuGFfNgOEZdwYVmGlmwBjWO6LoXP3MFAK4M5vAokQytg6A2AEJiltXYNUg4PDOV0qBNwpDCQpsZqS_-QUjATSGMU3D6IA Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: 36e37b94f6014a08a6523a6418b22ebc Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-720856204 Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:42:00.040594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:42:00.042767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/36e37b94f6014a08a6523a6418b22ebc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/36e37b94f6014a08a6523a6418b22ebc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_36e37b94f6014a08a6523a6418b22ebc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/36e37b94f6014a08a6523a6418b22ebc"}]}] Oct 27 17:42:00.042767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-VolumesSnapshotsTestJSON-720856204 Oct 27 17:42:00.042767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: 36e37b94f6014a08a6523a6418b22ebc Oct 27 17:42:00.042767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-720856204 Oct 27 17:42:00.042767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-VolumesSnapshotsTestJSON-720856204-project Oct 27 17:42:00.042767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:42:00.042767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:42:00.042767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 98e6b82f66dd483c8f63363ab47125ae Oct 27 17:42:00.042767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-VolumesSnapshotsTestJSON-720856204-project Oct 27 17:42:00.042767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: Oct 27 17:42:00.042767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. Oct 27 17:42:00.042767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': '80b5fe34-e283-48e4-b7b8-3dad79839ec7'} Oct 27 17:42:00.042767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. (HTTP 404) (Request-ID: req-43fe522d-72f4-4dae-b8af-2f43edd5aad2) Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:42:00.043748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 17:42:00.045075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 17:42:00.046355 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:42:00.047641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. Oct 27 17:42:00.047641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.047641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:42:00.047641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.047641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:00.047641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:42:00.047641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:42:00.047641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:42:00.047641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:42:00.047641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. Oct 27 17:42:00.047641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.047641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f8a32a80-afe4-4d1b-854b-23a789f0a2f6 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Returning 404 to user: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:42:00.047641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f8a32a80-afe4-4d1b-854b-23a789f0a2f6 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7" status: 404 len: 109 microversion: 2.1 time: 0.039566 Oct 27 17:42:00.047641 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 547/1067] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Oct 27 17:42:00 2022] GET /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:42:00.057576 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a6d05baa-ab2b-45ba-9f47-f8f9655e1027 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f0788510940>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:00.085529 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-a6d05baa-ab2b-45ba-9f47-f8f9655e1027 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] HTTP exception thrown: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a6d05baa-ab2b-45ba-9f47-f8f9655e1027 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Request method failure captured: Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: DELETE /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7 HTTP/1.1 Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsLfFPSr87zV8_RDpX6Enqkmg200PnkXDiuaiPdkgB-WFIg_N7xIZa_KcUtFvTg4UarQRrEc7UTzyUk0OOeuGFfNgOEZdwYVmGlmwBjWO6LoXP3MFAK4M5vAokQytg6A2AEJiltXYNUg4PDOV0qBNwpDCQpsZqS_-QUjATSGMU3D6IA Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: 36e37b94f6014a08a6523a6418b22ebc Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-720856204 Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:42:00.088693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:42:00.090401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/36e37b94f6014a08a6523a6418b22ebc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/36e37b94f6014a08a6523a6418b22ebc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_36e37b94f6014a08a6523a6418b22ebc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/36e37b94f6014a08a6523a6418b22ebc"}]}] Oct 27 17:42:00.090401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-VolumesSnapshotsTestJSON-720856204 Oct 27 17:42:00.090401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: 36e37b94f6014a08a6523a6418b22ebc Oct 27 17:42:00.090401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-720856204 Oct 27 17:42:00.090401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-VolumesSnapshotsTestJSON-720856204-project Oct 27 17:42:00.090401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:42:00.090401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:42:00.090401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 98e6b82f66dd483c8f63363ab47125ae Oct 27 17:42:00.090401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-VolumesSnapshotsTestJSON-720856204-project Oct 27 17:42:00.090401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: Oct 27 17:42:00.090401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. Oct 27 17:42:00.090401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '80b5fe34-e283-48e4-b7b8-3dad79839ec7'} Oct 27 17:42:00.090401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. (HTTP 404) (Request-ID: req-2a368711-14a8-4bbf-81bc-8445c20461ac) Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:42:00.091405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 17:42:00.092880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 17:42:00.094210 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:42:00.096707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. Oct 27 17:42:00.096707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.096707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:42:00.096707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.096707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:00.096707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:42:00.096707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:42:00.096707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:42:00.096707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:42:00.096707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. Oct 27 17:42:00.096707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.096707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-a6d05baa-ab2b-45ba-9f47-f8f9655e1027 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Returning 404 to user: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:42:00.096707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-a6d05baa-ab2b-45ba-9f47-f8f9655e1027 tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7" status: 404 len: 109 microversion: 2.1 time: 0.036586 Oct 27 17:42:00.096707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 521/1068] 10.222.0.36 () {58 vars in 1248 bytes} [Thu Oct 27 17:42:00 2022] DELETE /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:42:00.099268 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6718ffbb-b4ce-4323-85f1-99b26639038f tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Calling method '.version_select at 0x7f07886c7e50>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:00.129415 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-6718ffbb-b4ce-4323-85f1-99b26639038f tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] HTTP exception thrown: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6718ffbb-b4ce-4323-85f1-99b26639038f tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Request method failure captured: Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7 HTTP/1.1 Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsLfFPSr87zV8_RDpX6Enqkmg200PnkXDiuaiPdkgB-WFIg_N7xIZa_KcUtFvTg4UarQRrEc7UTzyUk0OOeuGFfNgOEZdwYVmGlmwBjWO6LoXP3MFAK4M5vAokQytg6A2AEJiltXYNUg4PDOV0qBNwpDCQpsZqS_-QUjATSGMU3D6IA Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: 36e37b94f6014a08a6523a6418b22ebc Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-720856204 Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:42:00.131378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:42:00.132947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/36e37b94f6014a08a6523a6418b22ebc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/36e37b94f6014a08a6523a6418b22ebc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_36e37b94f6014a08a6523a6418b22ebc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/36e37b94f6014a08a6523a6418b22ebc"}]}] Oct 27 17:42:00.132947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-VolumesSnapshotsTestJSON-720856204 Oct 27 17:42:00.132947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: 36e37b94f6014a08a6523a6418b22ebc Oct 27 17:42:00.132947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-720856204 Oct 27 17:42:00.132947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-VolumesSnapshotsTestJSON-720856204-project Oct 27 17:42:00.132947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:42:00.132947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:42:00.132947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 98e6b82f66dd483c8f63363ab47125ae Oct 27 17:42:00.132947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-VolumesSnapshotsTestJSON-720856204-project Oct 27 17:42:00.132947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: Oct 27 17:42:00.132947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. Oct 27 17:42:00.132947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': '80b5fe34-e283-48e4-b7b8-3dad79839ec7'} Oct 27 17:42:00.132947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. (HTTP 404) (Request-ID: req-4166a4f9-0738-4b70-8d1b-73d8663ec06d) Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:42:00.135235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 17:42:00.137151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 17:42:00.139500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:42:00.140897 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. Oct 27 17:42:00.140897 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.140897 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:42:00.140897 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.140897 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:00.140897 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:42:00.140897 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:42:00.140897 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:42:00.140897 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:42:00.140897 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. Oct 27 17:42:00.140897 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:00.140897 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6718ffbb-b4ce-4323-85f1-99b26639038f tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] Returning 404 to user: Volume 80b5fe34-e283-48e4-b7b8-3dad79839ec7 could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:42:00.140897 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6718ffbb-b4ce-4323-85f1-99b26639038f tempest-VolumesSnapshotsTestJSON-720856204 tempest-VolumesSnapshotsTestJSON-720856204-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7" status: 404 len: 109 microversion: 2.1 time: 0.037893 Oct 27 17:42:00.140897 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 548/1069] 10.222.0.36 () {58 vars in 1245 bytes} [Thu Oct 27 17:42:00 2022] GET /compute/v2.1/os-volumes/80b5fe34-e283-48e4-b7b8-3dad79839ec7 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:42:06.026388 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1330161749", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452", "networks": [{"uuid": "3a84ced8-ace5-4af0-9c35-f1aadd5ff6e7"}]}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:42:06.085591 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.network.neutron [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] validate_networks() for [('3a84ced8-ace5-4af0-9c35-f1aadd5ff6e7', None, None, None, None, None)] {{(pid=119046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:42:06.464280 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Flavor limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:42:06.464718 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Image limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:42:06.465167 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Flavor pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:42:06.465569 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Image pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:42:06.465973 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:42:06.474996 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:06.475474 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:06.475930 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:06.476651 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:06.477095 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:06.477513 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:06.494602 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Getting quotas for project 0bf2026fb6e24bd68a5bd2854b213436. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:42:06.499027 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Getting quotas for user 9b3b8a1d378d48cd9c35d1f25dc21efe and project 0bf2026fb6e24bd68a5bd2854b213436. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:42:06.509763 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Going to run 1 instances... {{(pid=119046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:42:06.512078 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:42:06.555937 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR oslo.messaging._drivers.impl_rabbit [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [ae6f072b-2f44-4f7f-aeaf-86f04fe02778] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 17:42:07.563855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO oslo.messaging._drivers.impl_rabbit [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [ae6f072b-2f44-4f7f-aeaf-86f04fe02778] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 52630. Oct 27 17:42:07.568107 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-56674304-c1fa-477d-b839-50aab5f35561 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.546192 Oct 27 17:42:07.568836 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 522/1070] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:42:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:42:07.582081 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4fe895d5-150b-4430-ad58-4912d811945a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:07.582764 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4fe895d5-150b-4430-ad58-4912d811945a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:07.640963 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4fe895d5-150b-4430-ad58-4912d811945a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:07.650465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4fe895d5-150b-4430-ad58-4912d811945a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1214 microversion: 2.1 time: 0.073871 Oct 27 17:42:07.661931 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 549/1071] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:07 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:08.674959 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-25e2767c-ce84-4e19-9b1f-c43516038e9c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:08.675605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-25e2767c-ce84-4e19-9b1f-c43516038e9c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:08.683988 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-25e2767c-ce84-4e19-9b1f-c43516038e9c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:08.683988 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-25e2767c-ce84-4e19-9b1f-c43516038e9c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:08.685521 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-25e2767c-ce84-4e19-9b1f-c43516038e9c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:08.686242 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-25e2767c-ce84-4e19-9b1f-c43516038e9c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:08.686704 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-25e2767c-ce84-4e19-9b1f-c43516038e9c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:08.687135 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-25e2767c-ce84-4e19-9b1f-c43516038e9c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:08.751465 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-25e2767c-ce84-4e19-9b1f-c43516038e9c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:08.759307 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-25e2767c-ce84-4e19-9b1f-c43516038e9c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1218 microversion: 2.1 time: 0.088913 Oct 27 17:42:08.759895 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 523/1072] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:08 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:09.784652 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2702db48-2766-4af7-8ba5-11e01326f77a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:09.785414 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2702db48-2766-4af7-8ba5-11e01326f77a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:09.792900 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2702db48-2766-4af7-8ba5-11e01326f77a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:09.793384 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2702db48-2766-4af7-8ba5-11e01326f77a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:09.793863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2702db48-2766-4af7-8ba5-11e01326f77a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:09.794854 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2702db48-2766-4af7-8ba5-11e01326f77a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:09.795420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2702db48-2766-4af7-8ba5-11e01326f77a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:09.795951 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2702db48-2766-4af7-8ba5-11e01326f77a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:09.863676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2702db48-2766-4af7-8ba5-11e01326f77a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:09.873438 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2702db48-2766-4af7-8ba5-11e01326f77a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1272 microversion: 2.1 time: 0.092923 Oct 27 17:42:09.873979 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 550/1073] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:09 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:10.899075 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-79ddb534-4bf9-4351-8741-98f63a1d1d75 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:10.900130 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-79ddb534-4bf9-4351-8741-98f63a1d1d75 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:10.907224 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-79ddb534-4bf9-4351-8741-98f63a1d1d75 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:10.907698 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-79ddb534-4bf9-4351-8741-98f63a1d1d75 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:10.908148 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-79ddb534-4bf9-4351-8741-98f63a1d1d75 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:10.908839 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-79ddb534-4bf9-4351-8741-98f63a1d1d75 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:10.909290 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-79ddb534-4bf9-4351-8741-98f63a1d1d75 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:10.909930 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-79ddb534-4bf9-4351-8741-98f63a1d1d75 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:11.158508 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-79ddb534-4bf9-4351-8741-98f63a1d1d75 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:11.167109 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-79ddb534-4bf9-4351-8741-98f63a1d1d75 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.272008 Oct 27 17:42:11.167720 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 524/1074] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:10 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:42:11.642930 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-5ed5cb14-3ad9-48a9-a4cb-b68444058d9c req-393fb335-635d-461f-ad84-47d00b5607bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab2d8a77-afcd-41e5-83a0-7457e87ece98", "tag": "62ad173e-1fc6-42b8-bb15-0039ec7cad90"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:42:11.653887 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-5ed5cb14-3ad9-48a9-a4cb-b68444058d9c req-393fb335-635d-461f-ad84-47d00b5607bc service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:11.654364 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-5ed5cb14-3ad9-48a9-a4cb-b68444058d9c req-393fb335-635d-461f-ad84-47d00b5607bc service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:11.654804 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-5ed5cb14-3ad9-48a9-a4cb-b68444058d9c req-393fb335-635d-461f-ad84-47d00b5607bc service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:11.669095 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-5ed5cb14-3ad9-48a9-a4cb-b68444058d9c req-393fb335-635d-461f-ad84-47d00b5607bc service nova] Creating event network-changed:62ad173e-1fc6-42b8-bb15-0039ec7cad90 for instance ab2d8a77-afcd-41e5-83a0-7457e87ece98 on hv-cinder-86283 Oct 27 17:42:11.674387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-5ed5cb14-3ad9-48a9-a4cb-b68444058d9c req-393fb335-635d-461f-ad84-47d00b5607bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035120 Oct 27 17:42:11.675431 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 551/1075] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:42:12.188853 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2311a0d5-d0ac-4031-9cde-59972205a776 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:12.189462 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2311a0d5-d0ac-4031-9cde-59972205a776 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:12.196075 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2311a0d5-d0ac-4031-9cde-59972205a776 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:12.196675 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2311a0d5-d0ac-4031-9cde-59972205a776 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:12.197122 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2311a0d5-d0ac-4031-9cde-59972205a776 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:12.197917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2311a0d5-d0ac-4031-9cde-59972205a776 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:12.198441 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2311a0d5-d0ac-4031-9cde-59972205a776 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:12.198868 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2311a0d5-d0ac-4031-9cde-59972205a776 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:12.333437 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-2311a0d5-d0ac-4031-9cde-59972205a776 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:12.342581 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2311a0d5-d0ac-4031-9cde-59972205a776 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.157608 Oct 27 17:42:12.343161 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 525/1076] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:12 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:42:13.367217 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-67d817c6-d6db-4f2b-b6d2-7d42b045b328 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:13.368566 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-67d817c6-d6db-4f2b-b6d2-7d42b045b328 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:13.375790 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67d817c6-d6db-4f2b-b6d2-7d42b045b328 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:13.376156 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67d817c6-d6db-4f2b-b6d2-7d42b045b328 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:13.376666 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67d817c6-d6db-4f2b-b6d2-7d42b045b328 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:13.377623 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67d817c6-d6db-4f2b-b6d2-7d42b045b328 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:13.378366 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67d817c6-d6db-4f2b-b6d2-7d42b045b328 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:13.378940 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67d817c6-d6db-4f2b-b6d2-7d42b045b328 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:13.517458 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-67d817c6-d6db-4f2b-b6d2-7d42b045b328 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:13.525103 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-67d817c6-d6db-4f2b-b6d2-7d42b045b328 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.162894 Oct 27 17:42:13.525674 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 552/1077] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:13 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:14.552367 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e1ce5992-e755-4d9b-80c5-6dbc6292f1e7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:14.552367 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e1ce5992-e755-4d9b-80c5-6dbc6292f1e7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:14.558335 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1ce5992-e755-4d9b-80c5-6dbc6292f1e7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:14.558826 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1ce5992-e755-4d9b-80c5-6dbc6292f1e7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:14.559259 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1ce5992-e755-4d9b-80c5-6dbc6292f1e7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:14.559997 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1ce5992-e755-4d9b-80c5-6dbc6292f1e7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:14.561011 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1ce5992-e755-4d9b-80c5-6dbc6292f1e7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:14.561443 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e1ce5992-e755-4d9b-80c5-6dbc6292f1e7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:14.793628 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e1ce5992-e755-4d9b-80c5-6dbc6292f1e7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:14.802824 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e1ce5992-e755-4d9b-80c5-6dbc6292f1e7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.258255 Oct 27 17:42:14.803486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 526/1078] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:14 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:15.825825 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-991cd690-d246-445e-8455-79e90f04c4c7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:15.826439 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-991cd690-d246-445e-8455-79e90f04c4c7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:15.833301 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-991cd690-d246-445e-8455-79e90f04c4c7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:15.833788 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-991cd690-d246-445e-8455-79e90f04c4c7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:15.834227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-991cd690-d246-445e-8455-79e90f04c4c7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:15.834923 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-991cd690-d246-445e-8455-79e90f04c4c7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:15.835377 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-991cd690-d246-445e-8455-79e90f04c4c7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:15.835831 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-991cd690-d246-445e-8455-79e90f04c4c7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:15.967334 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-991cd690-d246-445e-8455-79e90f04c4c7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:15.975382 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-991cd690-d246-445e-8455-79e90f04c4c7 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.154049 Oct 27 17:42:15.975918 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 553/1079] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:15 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:16.978704 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-3fcc03b4-5053-4d03-b658-df848c2ee12a req-61345ae0-38e6-47e5-906f-fc96a7ada85c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2d8a77-afcd-41e5-83a0-7457e87ece98", "name": "network-vif-plugged", "status": "completed", "tag": "62ad173e-1fc6-42b8-bb15-0039ec7cad90"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:42:16.985452 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=2 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:42:16.986517 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=6 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:42:16.993788 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-3fcc03b4-5053-4d03-b658-df848c2ee12a req-61345ae0-38e6-47e5-906f-fc96a7ada85c service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:16.994276 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-3fcc03b4-5053-4d03-b658-df848c2ee12a req-61345ae0-38e6-47e5-906f-fc96a7ada85c service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:16.997505 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-3fcc03b4-5053-4d03-b658-df848c2ee12a req-61345ae0-38e6-47e5-906f-fc96a7ada85c service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:17.004396 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-df9cf4d8-2470-419b-b539-166734118896 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:17.004998 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-df9cf4d8-2470-419b-b539-166734118896 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:17.011997 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df9cf4d8-2470-419b-b539-166734118896 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:17.012437 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df9cf4d8-2470-419b-b539-166734118896 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:17.012870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df9cf4d8-2470-419b-b539-166734118896 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:17.013555 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df9cf4d8-2470-419b-b539-166734118896 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:17.014161 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df9cf4d8-2470-419b-b539-166734118896 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:17.014724 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df9cf4d8-2470-419b-b539-166734118896 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:17.018691 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-3fcc03b4-5053-4d03-b658-df848c2ee12a req-61345ae0-38e6-47e5-906f-fc96a7ada85c service nova] Creating event network-vif-plugged:62ad173e-1fc6-42b8-bb15-0039ec7cad90 for instance ab2d8a77-afcd-41e5-83a0-7457e87ece98 on hv-cinder-86283 Oct 27 17:42:17.025489 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-3fcc03b4-5053-4d03-b658-df848c2ee12a req-61345ae0-38e6-47e5-906f-fc96a7ada85c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050559 Oct 27 17:42:17.026367 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 527/1080] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:42:17.143615 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-df9cf4d8-2470-419b-b539-166734118896 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:17.151216 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-df9cf4d8-2470-419b-b539-166734118896 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.151005 Oct 27 17:42:17.151801 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 554/1081] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:16 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:42:18.175523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-06d6a5b8-65f4-4c10-969a-d887ae4d9c30 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:18.176162 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-06d6a5b8-65f4-4c10-969a-d887ae4d9c30 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:18.182322 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-06d6a5b8-65f4-4c10-969a-d887ae4d9c30 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:18.182804 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-06d6a5b8-65f4-4c10-969a-d887ae4d9c30 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:18.183263 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-06d6a5b8-65f4-4c10-969a-d887ae4d9c30 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:18.184004 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-06d6a5b8-65f4-4c10-969a-d887ae4d9c30 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:18.184433 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-06d6a5b8-65f4-4c10-969a-d887ae4d9c30 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:18.184855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-06d6a5b8-65f4-4c10-969a-d887ae4d9c30 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:18.315040 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-06d6a5b8-65f4-4c10-969a-d887ae4d9c30 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:18.322615 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-06d6a5b8-65f4-4c10-969a-d887ae4d9c30 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.152024 Oct 27 17:42:18.323677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 528/1082] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:18 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:19.345644 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f463771e-8c23-45fb-9a38-7f683d6f1851 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:19.346364 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f463771e-8c23-45fb-9a38-7f683d6f1851 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:19.348957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:42:19.356154 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f463771e-8c23-45fb-9a38-7f683d6f1851 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:19.356652 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f463771e-8c23-45fb-9a38-7f683d6f1851 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:19.357121 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f463771e-8c23-45fb-9a38-7f683d6f1851 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:19.357835 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f463771e-8c23-45fb-9a38-7f683d6f1851 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:19.358287 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f463771e-8c23-45fb-9a38-7f683d6f1851 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:19.358714 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f463771e-8c23-45fb-9a38-7f683d6f1851 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:19.497411 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f463771e-8c23-45fb-9a38-7f683d6f1851 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:19.505283 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f463771e-8c23-45fb-9a38-7f683d6f1851 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.163487 Oct 27 17:42:19.505850 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 555/1083] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:19 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:20.528077 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-15771302-95f7-4225-88ec-4139ab1ccb82 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:20.528696 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-15771302-95f7-4225-88ec-4139ab1ccb82 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:20.535650 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-15771302-95f7-4225-88ec-4139ab1ccb82 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:20.536185 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-15771302-95f7-4225-88ec-4139ab1ccb82 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:20.536652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-15771302-95f7-4225-88ec-4139ab1ccb82 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:20.537365 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-15771302-95f7-4225-88ec-4139ab1ccb82 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:20.537822 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-15771302-95f7-4225-88ec-4139ab1ccb82 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:20.538249 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-15771302-95f7-4225-88ec-4139ab1ccb82 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:20.669003 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-15771302-95f7-4225-88ec-4139ab1ccb82 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:20.676708 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-15771302-95f7-4225-88ec-4139ab1ccb82 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.152612 Oct 27 17:42:20.677254 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 529/1084] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:20 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:21.699283 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a221421a-67b3-42bd-97cb-046d6fc495e5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:21.699917 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a221421a-67b3-42bd-97cb-046d6fc495e5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:21.706379 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a221421a-67b3-42bd-97cb-046d6fc495e5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:21.706856 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a221421a-67b3-42bd-97cb-046d6fc495e5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:21.707282 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a221421a-67b3-42bd-97cb-046d6fc495e5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:21.707992 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a221421a-67b3-42bd-97cb-046d6fc495e5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:21.708442 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a221421a-67b3-42bd-97cb-046d6fc495e5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:21.708862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a221421a-67b3-42bd-97cb-046d6fc495e5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:21.834105 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a221421a-67b3-42bd-97cb-046d6fc495e5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:21.842425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a221421a-67b3-42bd-97cb-046d6fc495e5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.147027 Oct 27 17:42:21.842982 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 556/1085] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:21 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:22.865783 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-10d02812-fcfd-47c8-9f9d-f94ccade743f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:22.866321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-10d02812-fcfd-47c8-9f9d-f94ccade743f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:22.873399 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10d02812-fcfd-47c8-9f9d-f94ccade743f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:22.873895 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10d02812-fcfd-47c8-9f9d-f94ccade743f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:22.874314 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10d02812-fcfd-47c8-9f9d-f94ccade743f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:22.875017 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10d02812-fcfd-47c8-9f9d-f94ccade743f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:22.875469 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10d02812-fcfd-47c8-9f9d-f94ccade743f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:22.875915 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-10d02812-fcfd-47c8-9f9d-f94ccade743f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:23.010783 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-10d02812-fcfd-47c8-9f9d-f94ccade743f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:23.018568 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-10d02812-fcfd-47c8-9f9d-f94ccade743f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.156806 Oct 27 17:42:23.019129 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 530/1086] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:22 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:24.041170 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0e1d30ce-07c3-4dd9-ad6a-c364c05cf8d6 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:24.041779 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-0e1d30ce-07c3-4dd9-ad6a-c364c05cf8d6 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:24.048199 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e1d30ce-07c3-4dd9-ad6a-c364c05cf8d6 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:24.048675 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e1d30ce-07c3-4dd9-ad6a-c364c05cf8d6 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:24.049106 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e1d30ce-07c3-4dd9-ad6a-c364c05cf8d6 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:24.049790 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e1d30ce-07c3-4dd9-ad6a-c364c05cf8d6 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:24.050237 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e1d30ce-07c3-4dd9-ad6a-c364c05cf8d6 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:24.050657 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0e1d30ce-07c3-4dd9-ad6a-c364c05cf8d6 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:24.180400 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-0e1d30ce-07c3-4dd9-ad6a-c364c05cf8d6 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:24.188721 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0e1d30ce-07c3-4dd9-ad6a-c364c05cf8d6 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.151358 Oct 27 17:42:24.189298 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 557/1087] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:24 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:25.210810 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-468184a7-bce4-4776-9774-1d510806b6c9 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:25.211419 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-468184a7-bce4-4776-9774-1d510806b6c9 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:25.218366 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-468184a7-bce4-4776-9774-1d510806b6c9 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:25.218841 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-468184a7-bce4-4776-9774-1d510806b6c9 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:25.219268 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-468184a7-bce4-4776-9774-1d510806b6c9 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:25.219971 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-468184a7-bce4-4776-9774-1d510806b6c9 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:25.220413 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-468184a7-bce4-4776-9774-1d510806b6c9 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:25.220825 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-468184a7-bce4-4776-9774-1d510806b6c9 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:25.350607 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-468184a7-bce4-4776-9774-1d510806b6c9 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:25.358374 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-468184a7-bce4-4776-9774-1d510806b6c9 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.151381 Oct 27 17:42:25.359023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 531/1088] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:25 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:26.382129 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-930f6341-a7b1-43ec-98e2-2e33d1c93734 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:26.382740 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-930f6341-a7b1-43ec-98e2-2e33d1c93734 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:26.388747 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-930f6341-a7b1-43ec-98e2-2e33d1c93734 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:26.389225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-930f6341-a7b1-43ec-98e2-2e33d1c93734 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:26.389660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-930f6341-a7b1-43ec-98e2-2e33d1c93734 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:26.390340 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-930f6341-a7b1-43ec-98e2-2e33d1c93734 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:26.390796 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-930f6341-a7b1-43ec-98e2-2e33d1c93734 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:26.391213 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-930f6341-a7b1-43ec-98e2-2e33d1c93734 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:26.519156 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-930f6341-a7b1-43ec-98e2-2e33d1c93734 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:26.526698 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-930f6341-a7b1-43ec-98e2-2e33d1c93734 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.148726 Oct 27 17:42:26.527781 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 558/1089] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:26 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:27.549778 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-334d9a33-c4b7-410c-9847-5f623b713540 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:27.550289 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-334d9a33-c4b7-410c-9847-5f623b713540 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:27.557387 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-334d9a33-c4b7-410c-9847-5f623b713540 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:27.557859 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-334d9a33-c4b7-410c-9847-5f623b713540 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:27.558898 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-334d9a33-c4b7-410c-9847-5f623b713540 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:27.559581 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-334d9a33-c4b7-410c-9847-5f623b713540 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:27.560062 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-334d9a33-c4b7-410c-9847-5f623b713540 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:27.560482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-334d9a33-c4b7-410c-9847-5f623b713540 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:27.694903 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-334d9a33-c4b7-410c-9847-5f623b713540 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:27.702459 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-334d9a33-c4b7-410c-9847-5f623b713540 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.156716 Oct 27 17:42:27.703036 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 532/1090] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:27 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:28.725883 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f41b2bc3-2730-47e4-aa64-a8e43306cd01 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:28.726521 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f41b2bc3-2730-47e4-aa64-a8e43306cd01 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:28.728826 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=23 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:42:28.735160 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f41b2bc3-2730-47e4-aa64-a8e43306cd01 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:28.735663 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f41b2bc3-2730-47e4-aa64-a8e43306cd01 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:28.736135 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f41b2bc3-2730-47e4-aa64-a8e43306cd01 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:28.736862 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f41b2bc3-2730-47e4-aa64-a8e43306cd01 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:28.737318 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f41b2bc3-2730-47e4-aa64-a8e43306cd01 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:28.737773 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f41b2bc3-2730-47e4-aa64-a8e43306cd01 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:28.868659 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f41b2bc3-2730-47e4-aa64-a8e43306cd01 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:28.876285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f41b2bc3-2730-47e4-aa64-a8e43306cd01 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.154631 Oct 27 17:42:28.876844 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 559/1091] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:28 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:29.899554 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-83a6485d-4de5-4fb3-891e-c50f21783bed tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:29.900181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-83a6485d-4de5-4fb3-891e-c50f21783bed tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:29.902620 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:42:29.908744 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83a6485d-4de5-4fb3-891e-c50f21783bed tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:29.909228 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83a6485d-4de5-4fb3-891e-c50f21783bed tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:29.909667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83a6485d-4de5-4fb3-891e-c50f21783bed tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:29.910354 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83a6485d-4de5-4fb3-891e-c50f21783bed tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:29.910812 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83a6485d-4de5-4fb3-891e-c50f21783bed tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:29.911240 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83a6485d-4de5-4fb3-891e-c50f21783bed tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:29.914352 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=59 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:42:30.039665 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-83a6485d-4de5-4fb3-891e-c50f21783bed tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:30.047861 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-83a6485d-4de5-4fb3-891e-c50f21783bed tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.152160 Oct 27 17:42:30.048428 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 533/1092] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:29 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:31.070598 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8c770f70-2f55-4d54-8e1a-bf17fc64aa14 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:31.071490 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8c770f70-2f55-4d54-8e1a-bf17fc64aa14 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:31.080067 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8c770f70-2f55-4d54-8e1a-bf17fc64aa14 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:31.080821 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8c770f70-2f55-4d54-8e1a-bf17fc64aa14 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:31.081265 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8c770f70-2f55-4d54-8e1a-bf17fc64aa14 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:31.081973 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8c770f70-2f55-4d54-8e1a-bf17fc64aa14 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:31.082431 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8c770f70-2f55-4d54-8e1a-bf17fc64aa14 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:31.082859 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8c770f70-2f55-4d54-8e1a-bf17fc64aa14 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:31.437238 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8c770f70-2f55-4d54-8e1a-bf17fc64aa14 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:31.444807 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8c770f70-2f55-4d54-8e1a-bf17fc64aa14 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.378273 Oct 27 17:42:31.445370 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 560/1093] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:31 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:42:32.473671 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d66da466-043a-44f5-bf59-28115c508ada tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:32.474202 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d66da466-043a-44f5-bf59-28115c508ada tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:32.480620 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d66da466-043a-44f5-bf59-28115c508ada tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:32.481097 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d66da466-043a-44f5-bf59-28115c508ada tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:32.481527 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d66da466-043a-44f5-bf59-28115c508ada tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:32.482209 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d66da466-043a-44f5-bf59-28115c508ada tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:32.482658 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d66da466-043a-44f5-bf59-28115c508ada tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:32.483076 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d66da466-043a-44f5-bf59-28115c508ada tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:32.614112 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d66da466-043a-44f5-bf59-28115c508ada tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:32.622794 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d66da466-043a-44f5-bf59-28115c508ada tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.153291 Oct 27 17:42:32.623494 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 534/1094] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:32 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:33.646126 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-630a7a93-4204-4a4d-8dc4-2dd7809cc46c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:33.646731 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-630a7a93-4204-4a4d-8dc4-2dd7809cc46c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:33.653835 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-630a7a93-4204-4a4d-8dc4-2dd7809cc46c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:33.654310 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-630a7a93-4204-4a4d-8dc4-2dd7809cc46c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:33.654738 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-630a7a93-4204-4a4d-8dc4-2dd7809cc46c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:33.655427 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-630a7a93-4204-4a4d-8dc4-2dd7809cc46c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:33.655905 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-630a7a93-4204-4a4d-8dc4-2dd7809cc46c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:33.656329 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-630a7a93-4204-4a4d-8dc4-2dd7809cc46c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:33.784555 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-630a7a93-4204-4a4d-8dc4-2dd7809cc46c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:33.792221 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-630a7a93-4204-4a4d-8dc4-2dd7809cc46c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.149917 Oct 27 17:42:33.792864 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 561/1095] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:33 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:34.815138 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7183596c-4d25-48f1-a69d-4b858cd1ea3f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:34.816355 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7183596c-4d25-48f1-a69d-4b858cd1ea3f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:34.822692 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7183596c-4d25-48f1-a69d-4b858cd1ea3f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:34.823172 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7183596c-4d25-48f1-a69d-4b858cd1ea3f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:34.823605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7183596c-4d25-48f1-a69d-4b858cd1ea3f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:34.824317 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7183596c-4d25-48f1-a69d-4b858cd1ea3f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:34.824762 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7183596c-4d25-48f1-a69d-4b858cd1ea3f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:34.825181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7183596c-4d25-48f1-a69d-4b858cd1ea3f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:34.960865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7183596c-4d25-48f1-a69d-4b858cd1ea3f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:34.969184 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7183596c-4d25-48f1-a69d-4b858cd1ea3f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1314 microversion: 2.1 time: 0.157940 Oct 27 17:42:34.969774 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 535/1096] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:34 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:35.993465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-ea050da0-ce79-4dde-b4ac-91a57a9a8410 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:35.994165 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-ea050da0-ce79-4dde-b4ac-91a57a9a8410 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:36.001402 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ea050da0-ce79-4dde-b4ac-91a57a9a8410 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:36.001854 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ea050da0-ce79-4dde-b4ac-91a57a9a8410 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:36.002290 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ea050da0-ce79-4dde-b4ac-91a57a9a8410 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:36.002980 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ea050da0-ce79-4dde-b4ac-91a57a9a8410 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:36.003432 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ea050da0-ce79-4dde-b4ac-91a57a9a8410 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:36.003898 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-ea050da0-ce79-4dde-b4ac-91a57a9a8410 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:36.131385 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-ea050da0-ce79-4dde-b4ac-91a57a9a8410 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:36.143356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-ea050da0-ce79-4dde-b4ac-91a57a9a8410 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1496 microversion: 2.1 time: 0.153911 Oct 27 17:42:36.143993 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 562/1097] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:35 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1496 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:36.701132 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-2164f404-4aa4-47ed-b34f-24442c1cce02 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:36.701630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2164f404-4aa4-47ed-b34f-24442c1cce02 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:36.708169 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2164f404-4aa4-47ed-b34f-24442c1cce02 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:36.708646 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2164f404-4aa4-47ed-b34f-24442c1cce02 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:36.709074 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2164f404-4aa4-47ed-b34f-24442c1cce02 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:36.709758 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2164f404-4aa4-47ed-b34f-24442c1cce02 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:36.710211 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2164f404-4aa4-47ed-b34f-24442c1cce02 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:36.710633 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-2164f404-4aa4-47ed-b34f-24442c1cce02 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:36.738008 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-2164f404-4aa4-47ed-b34f-24442c1cce02 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Going to try to terminate instance {{(pid=119046) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:42:36.814499 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-2164f404-4aa4-47ed-b34f-24442c1cce02 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 204 len: 0 microversion: 2.1 time: 0.117436 Oct 27 17:42:36.816026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 536/1098] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:42:36 2022] DELETE /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:42:36.824207 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5a5e0279-4dbc-4455-a256-f0b7c369513c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:36.824945 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-5a5e0279-4dbc-4455-a256-f0b7c369513c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:36.831928 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5a5e0279-4dbc-4455-a256-f0b7c369513c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:36.832530 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5a5e0279-4dbc-4455-a256-f0b7c369513c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:36.833043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5a5e0279-4dbc-4455-a256-f0b7c369513c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:36.833912 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5a5e0279-4dbc-4455-a256-f0b7c369513c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:36.834421 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5a5e0279-4dbc-4455-a256-f0b7c369513c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:36.834923 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5a5e0279-4dbc-4455-a256-f0b7c369513c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:36.962473 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-5a5e0279-4dbc-4455-a256-f0b7c369513c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:36.970094 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5a5e0279-4dbc-4455-a256-f0b7c369513c tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1502 microversion: 2.1 time: 0.150070 Oct 27 17:42:36.970686 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 563/1099] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:36 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:37.994316 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7a5db96c-6117-4de4-a6cf-e4a070bc9bce tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:37.995018 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7a5db96c-6117-4de4-a6cf-e4a070bc9bce tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:38.004343 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7a5db96c-6117-4de4-a6cf-e4a070bc9bce tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:38.004343 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7a5db96c-6117-4de4-a6cf-e4a070bc9bce tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:38.004343 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7a5db96c-6117-4de4-a6cf-e4a070bc9bce tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:38.004343 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7a5db96c-6117-4de4-a6cf-e4a070bc9bce tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:38.004770 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7a5db96c-6117-4de4-a6cf-e4a070bc9bce tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:38.004770 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7a5db96c-6117-4de4-a6cf-e4a070bc9bce tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:38.137566 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-7a5db96c-6117-4de4-a6cf-e4a070bc9bce tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:38.145503 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7a5db96c-6117-4de4-a6cf-e4a070bc9bce tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1502 microversion: 2.1 time: 0.155714 Oct 27 17:42:38.146157 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 537/1100] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:37 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:39.169753 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-3afb5f63-deec-4b69-968a-0ce05acacd69 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:39.170454 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-3afb5f63-deec-4b69-968a-0ce05acacd69 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:39.176886 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3afb5f63-deec-4b69-968a-0ce05acacd69 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:39.177364 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3afb5f63-deec-4b69-968a-0ce05acacd69 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:39.177791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3afb5f63-deec-4b69-968a-0ce05acacd69 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:39.178482 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3afb5f63-deec-4b69-968a-0ce05acacd69 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:39.178929 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3afb5f63-deec-4b69-968a-0ce05acacd69 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:39.179348 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-3afb5f63-deec-4b69-968a-0ce05acacd69 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:39.251020 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-c7a063c3-35f3-4e40-8d8d-62ad312f6c1f req-41133693-5e31-4682-8e83-bb138e89402f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2d8a77-afcd-41e5-83a0-7457e87ece98", "name": "network-vif-deleted", "tag": "62ad173e-1fc6-42b8-bb15-0039ec7cad90"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:42:39.259609 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-3afb5f63-deec-4b69-968a-0ce05acacd69 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:39.261345 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-c7a063c3-35f3-4e40-8d8d-62ad312f6c1f req-41133693-5e31-4682-8e83-bb138e89402f service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:39.261826 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-c7a063c3-35f3-4e40-8d8d-62ad312f6c1f req-41133693-5e31-4682-8e83-bb138e89402f service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:39.262300 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-c7a063c3-35f3-4e40-8d8d-62ad312f6c1f req-41133693-5e31-4682-8e83-bb138e89402f service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:39.269536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-3afb5f63-deec-4b69-968a-0ce05acacd69 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 200 len: 1460 microversion: 2.1 time: 0.103939 Oct 27 17:42:39.270307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 564/1101] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:39 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 1460 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:39.276973 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-c7a063c3-35f3-4e40-8d8d-62ad312f6c1f req-41133693-5e31-4682-8e83-bb138e89402f service nova] Creating event network-vif-deleted:62ad173e-1fc6-42b8-bb15-0039ec7cad90 for instance ab2d8a77-afcd-41e5-83a0-7457e87ece98 on hv-cinder-86283 Oct 27 17:42:39.282809 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-c7a063c3-35f3-4e40-8d8d-62ad312f6c1f req-41133693-5e31-4682-8e83-bb138e89402f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035832 Oct 27 17:42:39.283509 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 538/1102] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:42:40.292799 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-cc957280-fccc-49ef-a6d3-d98d8bb9bf1e tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:40.293406 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-cc957280-fccc-49ef-a6d3-d98d8bb9bf1e tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: ab2d8a77-afcd-41e5-83a0-7457e87ece98] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:40.299802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cc957280-fccc-49ef-a6d3-d98d8bb9bf1e tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:40.300278 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cc957280-fccc-49ef-a6d3-d98d8bb9bf1e tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:40.300704 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cc957280-fccc-49ef-a6d3-d98d8bb9bf1e tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:40.301380 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cc957280-fccc-49ef-a6d3-d98d8bb9bf1e tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:40.301825 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cc957280-fccc-49ef-a6d3-d98d8bb9bf1e tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:40.302241 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cc957280-fccc-49ef-a6d3-d98d8bb9bf1e tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:40.304805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=87 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:42:40.315919 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-cc957280-fccc-49ef-a6d3-d98d8bb9bf1e tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] HTTP exception thrown: Instance ab2d8a77-afcd-41e5-83a0-7457e87ece98 could not be found. Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-cc957280-fccc-49ef-a6d3-d98d8bb9bf1e tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Request method failure captured: Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 HTTP/1.1 Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsLsxE94KUdKXzy_idpQhszvmXsAXMlr6lfiIS0_1fCNnjHz0Jwiqb5YNRxXG8EpOn1qFhWtbXiDf-46WuYe-JC8XMOt-kFiOmgr2JDIo0T1xiF0ag2kru6VttyIb3zuJjhclcodXe-D6TO4U9a8Cojn-8RSq1ptju6Ey5p_phjznfg Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: 0bf2026fb6e24bd68a5bd2854b213436 Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-VolumesActionsTest-1738971915 Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:42:40.317529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:42:40.319186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bf2026fb6e24bd68a5bd2854b213436"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bf2026fb6e24bd68a5bd2854b213436"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bf2026fb6e24bd68a5bd2854b213436"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bf2026fb6e24bd68a5bd2854b213436"}]}] Oct 27 17:42:40.319186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-VolumesActionsTest-1738971915 Oct 27 17:42:40.319186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: 0bf2026fb6e24bd68a5bd2854b213436 Oct 27 17:42:40.319186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-VolumesActionsTest-1738971915 Oct 27 17:42:40.319186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-VolumesActionsTest-1738971915-project Oct 27 17:42:40.319186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:42:40.319186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:42:40.319186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 9b3b8a1d378d48cd9c35d1f25dc21efe Oct 27 17:42:40.319186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-VolumesActionsTest-1738971915-project Oct 27 17:42:40.319186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:42:40.319186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance ab2d8a77-afcd-41e5-83a0-7457e87ece98 could not be found. Oct 27 17:42:40.319186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': 'ab2d8a77-afcd-41e5-83a0-7457e87ece98'} Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2d8a77-afcd-41e5-83a0-7457e87ece98 could not be found. Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:42:40.320158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2d8a77-afcd-41e5-83a0-7457e87ece98 could not be found. Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2d8a77-afcd-41e5-83a0-7457e87ece98 could not be found. Oct 27 17:42:40.321512 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:42:40.322803 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-cc957280-fccc-49ef-a6d3-d98d8bb9bf1e tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Returning 404 to user: Instance ab2d8a77-afcd-41e5-83a0-7457e87ece98 could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:42:40.322803 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-cc957280-fccc-49ef-a6d3-d98d8bb9bf1e tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98" status: 404 len: 111 microversion: 2.1 time: 0.030057 Oct 27 17:42:40.322803 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 565/1103] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:40 2022] GET /compute/v2.1/servers/ab2d8a77-afcd-41e5-83a0-7457e87ece98 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:42:40.418304 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1455311192", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452", "networks": [{"uuid": "3a84ced8-ace5-4af0-9c35-f1aadd5ff6e7"}]}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:42:40.471123 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.network.neutron [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] validate_networks() for [('3a84ced8-ace5-4af0-9c35-f1aadd5ff6e7', None, None, None, None, None)] {{(pid=119046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:42:40.905804 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Flavor limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:42:40.906219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Image limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:42:40.906711 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Flavor pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:42:40.907111 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Image pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:42:40.907513 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:42:40.916232 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:40.916701 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:40.917128 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:40.917855 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:40.918286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:40.918701 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:40.935422 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Getting quotas for project 0bf2026fb6e24bd68a5bd2854b213436. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:42:40.939980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Getting quotas for user 9b3b8a1d378d48cd9c35d1f25dc21efe and project 0bf2026fb6e24bd68a5bd2854b213436. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:42:40.950616 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Going to run 1 instances... {{(pid=119046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:42:40.952958 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:42:40.998439 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-74ad5360-87d3-441d-a6cf-3d4b56736e66 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584391 Oct 27 17:42:40.999751 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 539/1104] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:42:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:42:41.010659 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-e4ec48ba-e5e1-4c27-b879-50b854276bae tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:41.011273 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-e4ec48ba-e5e1-4c27-b879-50b854276bae tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:41.079833 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-e4ec48ba-e5e1-4c27-b879-50b854276bae tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:41.088378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-e4ec48ba-e5e1-4c27-b879-50b854276bae tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 200 len: 1214 microversion: 2.1 time: 0.081507 Oct 27 17:42:41.089286 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 566/1105] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:41 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:42.112713 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ea35fe39-7b66-4be4-b8c0-f8e43e7dc572 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:42.113327 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ea35fe39-7b66-4be4-b8c0-f8e43e7dc572 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:42.132763 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ea35fe39-7b66-4be4-b8c0-f8e43e7dc572 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:42.133268 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ea35fe39-7b66-4be4-b8c0-f8e43e7dc572 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:42.133770 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ea35fe39-7b66-4be4-b8c0-f8e43e7dc572 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:42.134542 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ea35fe39-7b66-4be4-b8c0-f8e43e7dc572 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:42.135002 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ea35fe39-7b66-4be4-b8c0-f8e43e7dc572 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:42.135429 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ea35fe39-7b66-4be4-b8c0-f8e43e7dc572 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:42.214675 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ea35fe39-7b66-4be4-b8c0-f8e43e7dc572 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:42.228934 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ea35fe39-7b66-4be4-b8c0-f8e43e7dc572 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 200 len: 1274 microversion: 2.1 time: 0.120903 Oct 27 17:42:42.230079 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 540/1106] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:42 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:43.254466 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-14736c69-ec37-48a3-a893-4f62617dc067 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:43.255073 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-14736c69-ec37-48a3-a893-4f62617dc067 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:43.262508 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-14736c69-ec37-48a3-a893-4f62617dc067 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:43.262990 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-14736c69-ec37-48a3-a893-4f62617dc067 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:43.263420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-14736c69-ec37-48a3-a893-4f62617dc067 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:43.264130 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-14736c69-ec37-48a3-a893-4f62617dc067 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:43.265085 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-14736c69-ec37-48a3-a893-4f62617dc067 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:43.265503 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-14736c69-ec37-48a3-a893-4f62617dc067 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:43.397682 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-14736c69-ec37-48a3-a893-4f62617dc067 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:43.405461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-14736c69-ec37-48a3-a893-4f62617dc067 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 200 len: 1314 microversion: 2.1 time: 0.154937 Oct 27 17:42:43.406026 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 567/1107] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:43 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:43.511378 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-dc52bb78-15ba-462e-bdea-ec8a93f07b9f req-b07c4450-a8cd-4d2b-bd5c-45589871fb2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa1db3bd-e218-425e-ad45-9c0a80cb40cd", "tag": "78a1b310-ac20-45b1-a456-852d870f0840"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:42:43.522443 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-dc52bb78-15ba-462e-bdea-ec8a93f07b9f req-b07c4450-a8cd-4d2b-bd5c-45589871fb2e service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:43.522917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-dc52bb78-15ba-462e-bdea-ec8a93f07b9f req-b07c4450-a8cd-4d2b-bd5c-45589871fb2e service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:43.523948 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-dc52bb78-15ba-462e-bdea-ec8a93f07b9f req-b07c4450-a8cd-4d2b-bd5c-45589871fb2e service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:43.535971 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-dc52bb78-15ba-462e-bdea-ec8a93f07b9f req-b07c4450-a8cd-4d2b-bd5c-45589871fb2e service nova] Creating event network-changed:78a1b310-ac20-45b1-a456-852d870f0840 for instance aa1db3bd-e218-425e-ad45-9c0a80cb40cd on hv-cinder-86283 Oct 27 17:42:43.540808 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-dc52bb78-15ba-462e-bdea-ec8a93f07b9f req-b07c4450-a8cd-4d2b-bd5c-45589871fb2e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033224 Oct 27 17:42:43.541399 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 541/1108] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:42:44.428724 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a634fb34-0d0f-4335-a1db-2268358d6bb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:44.429953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a634fb34-0d0f-4335-a1db-2268358d6bb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:44.437755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a634fb34-0d0f-4335-a1db-2268358d6bb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:44.438452 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a634fb34-0d0f-4335-a1db-2268358d6bb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:44.439115 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a634fb34-0d0f-4335-a1db-2268358d6bb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:44.440093 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a634fb34-0d0f-4335-a1db-2268358d6bb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:44.441065 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a634fb34-0d0f-4335-a1db-2268358d6bb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:44.441705 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a634fb34-0d0f-4335-a1db-2268358d6bb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:44.597003 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a634fb34-0d0f-4335-a1db-2268358d6bb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:44.606357 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a634fb34-0d0f-4335-a1db-2268358d6bb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 200 len: 1314 microversion: 2.1 time: 0.181581 Oct 27 17:42:44.623806 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 568/1109] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:44 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:45.631795 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-93912511-7d37-4db0-8f43-f23728f4c8a8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:45.633027 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-93912511-7d37-4db0-8f43-f23728f4c8a8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:45.640292 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-93912511-7d37-4db0-8f43-f23728f4c8a8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:45.640771 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-93912511-7d37-4db0-8f43-f23728f4c8a8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:45.641201 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-93912511-7d37-4db0-8f43-f23728f4c8a8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:45.641890 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-93912511-7d37-4db0-8f43-f23728f4c8a8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:45.642339 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-93912511-7d37-4db0-8f43-f23728f4c8a8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:45.642760 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-93912511-7d37-4db0-8f43-f23728f4c8a8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:45.776415 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-93912511-7d37-4db0-8f43-f23728f4c8a8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:45.784760 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-93912511-7d37-4db0-8f43-f23728f4c8a8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 200 len: 1314 microversion: 2.1 time: 0.157612 Oct 27 17:42:45.785328 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 542/1110] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:45 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:46.807368 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1521a049-1e56-4e57-a9d0-b2422a65ee4d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:46.807928 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-1521a049-1e56-4e57-a9d0-b2422a65ee4d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:46.814323 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1521a049-1e56-4e57-a9d0-b2422a65ee4d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:46.814795 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1521a049-1e56-4e57-a9d0-b2422a65ee4d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:46.815224 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1521a049-1e56-4e57-a9d0-b2422a65ee4d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:46.815942 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1521a049-1e56-4e57-a9d0-b2422a65ee4d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:46.816392 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1521a049-1e56-4e57-a9d0-b2422a65ee4d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:46.816811 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1521a049-1e56-4e57-a9d0-b2422a65ee4d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:46.950201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1521a049-1e56-4e57-a9d0-b2422a65ee4d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:46.958393 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1521a049-1e56-4e57-a9d0-b2422a65ee4d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 200 len: 1314 microversion: 2.1 time: 0.154990 Oct 27 17:42:46.959046 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 569/1111] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:46 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:47.982465 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6a9372db-441d-4f95-bafa-5696fc8131c8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:47.983031 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6a9372db-441d-4f95-bafa-5696fc8131c8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:47.990040 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6a9372db-441d-4f95-bafa-5696fc8131c8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:47.990520 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6a9372db-441d-4f95-bafa-5696fc8131c8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:47.990954 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6a9372db-441d-4f95-bafa-5696fc8131c8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:47.991636 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6a9372db-441d-4f95-bafa-5696fc8131c8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:47.992111 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6a9372db-441d-4f95-bafa-5696fc8131c8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:47.992531 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6a9372db-441d-4f95-bafa-5696fc8131c8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:48.116755 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-6a9372db-441d-4f95-bafa-5696fc8131c8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:48.124947 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6a9372db-441d-4f95-bafa-5696fc8131c8 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 200 len: 1314 microversion: 2.1 time: 0.146438 Oct 27 17:42:48.125516 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 543/1112] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:47 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:49.148120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-81677bf4-d769-4b17-af12-0b89491148e4 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:49.148798 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-81677bf4-d769-4b17-af12-0b89491148e4 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:49.156287 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81677bf4-d769-4b17-af12-0b89491148e4 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:49.157647 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81677bf4-d769-4b17-af12-0b89491148e4 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:49.158076 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81677bf4-d769-4b17-af12-0b89491148e4 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:49.159141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81677bf4-d769-4b17-af12-0b89491148e4 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:49.159680 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81677bf4-d769-4b17-af12-0b89491148e4 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:49.160213 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81677bf4-d769-4b17-af12-0b89491148e4 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:49.221824 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-da1b0035-83a1-4ebc-8d48-f4f45bdceb42 req-3ae0816d-d15d-4ee1-a282-c3ffe30a8eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa1db3bd-e218-425e-ad45-9c0a80cb40cd", "name": "network-vif-plugged", "status": "completed", "tag": "78a1b310-ac20-45b1-a456-852d870f0840"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:42:49.231821 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-da1b0035-83a1-4ebc-8d48-f4f45bdceb42 req-3ae0816d-d15d-4ee1-a282-c3ffe30a8eef service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:49.232305 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-da1b0035-83a1-4ebc-8d48-f4f45bdceb42 req-3ae0816d-d15d-4ee1-a282-c3ffe30a8eef service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:49.232736 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-da1b0035-83a1-4ebc-8d48-f4f45bdceb42 req-3ae0816d-d15d-4ee1-a282-c3ffe30a8eef service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:49.243811 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-da1b0035-83a1-4ebc-8d48-f4f45bdceb42 req-3ae0816d-d15d-4ee1-a282-c3ffe30a8eef service nova] Creating event network-vif-plugged:78a1b310-ac20-45b1-a456-852d870f0840 for instance aa1db3bd-e218-425e-ad45-9c0a80cb40cd on hv-cinder-86283 Oct 27 17:42:49.249033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-da1b0035-83a1-4ebc-8d48-f4f45bdceb42 req-3ae0816d-d15d-4ee1-a282-c3ffe30a8eef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153106 Oct 27 17:42:49.249808 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 570/1113] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:42:49.297993 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-81677bf4-d769-4b17-af12-0b89491148e4 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:49.306059 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-81677bf4-d769-4b17-af12-0b89491148e4 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 200 len: 1314 microversion: 2.1 time: 0.161647 Oct 27 17:42:49.308740 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 544/1114] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:49 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:42:50.328872 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c70ad2b3-308b-4004-838a-7fb923a4471f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:50.330492 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c70ad2b3-308b-4004-838a-7fb923a4471f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:50.337514 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c70ad2b3-308b-4004-838a-7fb923a4471f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:50.337985 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c70ad2b3-308b-4004-838a-7fb923a4471f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:50.338601 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c70ad2b3-308b-4004-838a-7fb923a4471f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:50.339706 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c70ad2b3-308b-4004-838a-7fb923a4471f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:50.340501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c70ad2b3-308b-4004-838a-7fb923a4471f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:50.340999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c70ad2b3-308b-4004-838a-7fb923a4471f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:50.493395 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c70ad2b3-308b-4004-838a-7fb923a4471f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:50.501923 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c70ad2b3-308b-4004-838a-7fb923a4471f tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 200 len: 1314 microversion: 2.1 time: 0.177745 Oct 27 17:42:50.502491 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 571/1115] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:50 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:51.525920 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-83fd1585-c4f2-49a8-b4ec-c3948a2eb653 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:51.526635 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-83fd1585-c4f2-49a8-b4ec-c3948a2eb653 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:51.529981 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=2 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:42:51.531458 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=6 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:42:51.537736 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83fd1585-c4f2-49a8-b4ec-c3948a2eb653 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:51.538218 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83fd1585-c4f2-49a8-b4ec-c3948a2eb653 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:51.538655 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83fd1585-c4f2-49a8-b4ec-c3948a2eb653 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:51.539526 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83fd1585-c4f2-49a8-b4ec-c3948a2eb653 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:51.540281 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83fd1585-c4f2-49a8-b4ec-c3948a2eb653 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:51.540846 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83fd1585-c4f2-49a8-b4ec-c3948a2eb653 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:51.708352 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-83fd1585-c4f2-49a8-b4ec-c3948a2eb653 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:51.717191 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-83fd1585-c4f2-49a8-b4ec-c3948a2eb653 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 200 len: 1496 microversion: 2.1 time: 0.195226 Oct 27 17:42:51.717797 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 545/1116] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:51 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 1496 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:52.476733 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8bca754c-7233-40f9-962e-cc34a571e719 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:52.477289 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8bca754c-7233-40f9-962e-cc34a571e719 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:52.479153 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:42:52.484999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8bca754c-7233-40f9-962e-cc34a571e719 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:52.485486 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8bca754c-7233-40f9-962e-cc34a571e719 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:52.485921 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8bca754c-7233-40f9-962e-cc34a571e719 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:52.486615 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8bca754c-7233-40f9-962e-cc34a571e719 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:52.487067 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8bca754c-7233-40f9-962e-cc34a571e719 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:52.487490 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8bca754c-7233-40f9-962e-cc34a571e719 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:52.513787 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8bca754c-7233-40f9-962e-cc34a571e719 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Going to try to terminate instance {{(pid=119047) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:42:52.592604 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8bca754c-7233-40f9-962e-cc34a571e719 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "DELETE /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 204 len: 0 microversion: 2.1 time: 0.119652 Oct 27 17:42:52.593211 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 572/1117] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:42:52 2022] DELETE /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:42:52.601970 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8368caa0-23a3-45e7-b9d4-f21ac369e41a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:52.602583 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8368caa0-23a3-45e7-b9d4-f21ac369e41a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:52.608978 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8368caa0-23a3-45e7-b9d4-f21ac369e41a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:52.609462 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8368caa0-23a3-45e7-b9d4-f21ac369e41a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:52.609898 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8368caa0-23a3-45e7-b9d4-f21ac369e41a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:52.610582 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8368caa0-23a3-45e7-b9d4-f21ac369e41a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:52.611035 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8368caa0-23a3-45e7-b9d4-f21ac369e41a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:52.611452 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8368caa0-23a3-45e7-b9d4-f21ac369e41a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:52.745049 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8368caa0-23a3-45e7-b9d4-f21ac369e41a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:52.753434 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8368caa0-23a3-45e7-b9d4-f21ac369e41a tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 200 len: 1502 microversion: 2.1 time: 0.155610 Oct 27 17:42:52.754007 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 546/1118] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:52 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:53.186627 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-832634974", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452", "networks": [{"uuid": "29be1e99-94b7-4b54-bbe7-329fba4bbba4"}]}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:42:53.238527 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.network.neutron [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] validate_networks() for [('29be1e99-94b7-4b54-bbe7-329fba4bbba4', None, None, None, None, None)] {{(pid=119047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:42:53.631564 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Flavor limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:42:53.632102 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Image limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:42:53.632500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Flavor pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:42:53.632906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Image pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:42:53.633316 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:42:53.642669 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:53.643140 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:53.643569 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:53.644318 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:53.644772 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:53.645191 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:53.662945 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Getting quotas for project 737d405702b943f1aaab986473bc833d. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:42:53.667085 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Getting quotas for user a6295a8005ea40ffb4d48cf86bb3c626 and project 737d405702b943f1aaab986473bc833d. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:42:53.678237 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Going to run 1 instances... {{(pid=119047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:42:53.680654 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:42:53.724375 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR oslo.messaging._drivers.impl_rabbit [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [c752b25c-738c-4f5b-8238-3c85339ebd11] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 17:42:53.776550 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-312072ba-356d-478e-9006-cda5890dfbb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:53.777158 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-312072ba-356d-478e-9006-cda5890dfbb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:53.784225 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-312072ba-356d-478e-9006-cda5890dfbb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:53.784705 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-312072ba-356d-478e-9006-cda5890dfbb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:53.785172 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-312072ba-356d-478e-9006-cda5890dfbb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:53.785860 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-312072ba-356d-478e-9006-cda5890dfbb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:53.786315 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-312072ba-356d-478e-9006-cda5890dfbb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:53.786736 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-312072ba-356d-478e-9006-cda5890dfbb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:53.916130 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-312072ba-356d-478e-9006-cda5890dfbb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:53.923796 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-312072ba-356d-478e-9006-cda5890dfbb5 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 200 len: 1502 microversion: 2.1 time: 0.151095 Oct 27 17:42:53.924298 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 547/1119] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:53 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:42:54.731347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO oslo.messaging._drivers.impl_rabbit [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [c752b25c-738c-4f5b-8238-3c85339ebd11] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 53502. Oct 27 17:42:54.736135 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-185075da-5306-44c8-94c7-d8125225c158 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.553686 Oct 27 17:42:54.736944 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 573/1120] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:42:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:42:54.747930 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4353ced8-9930-4abe-a9b3-218236c7bd5b tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:54.748535 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4353ced8-9930-4abe-a9b3-218236c7bd5b tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:54.801265 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4353ced8-9930-4abe-a9b3-218236c7bd5b tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:54.808143 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4353ced8-9930-4abe-a9b3-218236c7bd5b tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1218 microversion: 2.1 time: 0.064128 Oct 27 17:42:54.808713 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 548/1121] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:54 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:54.946599 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8008d8e6-0412-4028-af34-bdf8626f1b67 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:54.947212 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8008d8e6-0412-4028-af34-bdf8626f1b67 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:54.953836 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8008d8e6-0412-4028-af34-bdf8626f1b67 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:54.954365 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8008d8e6-0412-4028-af34-bdf8626f1b67 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:54.955082 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8008d8e6-0412-4028-af34-bdf8626f1b67 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:54.955948 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8008d8e6-0412-4028-af34-bdf8626f1b67 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:54.956403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8008d8e6-0412-4028-af34-bdf8626f1b67 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:54.956823 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8008d8e6-0412-4028-af34-bdf8626f1b67 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:55.094237 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8008d8e6-0412-4028-af34-bdf8626f1b67 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:55.103077 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8008d8e6-0412-4028-af34-bdf8626f1b67 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 200 len: 1502 microversion: 2.1 time: 0.160525 Oct 27 17:42:55.104319 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 574/1122] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:54 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:55.830730 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d6c5962d-ff10-4a41-b074-732e362f730a tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:55.831244 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d6c5962d-ff10-4a41-b074-732e362f730a tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:55.838680 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d6c5962d-ff10-4a41-b074-732e362f730a tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:55.839154 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d6c5962d-ff10-4a41-b074-732e362f730a tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:55.839578 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d6c5962d-ff10-4a41-b074-732e362f730a tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:55.840288 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d6c5962d-ff10-4a41-b074-732e362f730a tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:55.840731 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d6c5962d-ff10-4a41-b074-732e362f730a tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:55.841145 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d6c5962d-ff10-4a41-b074-732e362f730a tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:55.900181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d6c5962d-ff10-4a41-b074-732e362f730a tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:55.907655 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d6c5962d-ff10-4a41-b074-732e362f730a tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1222 microversion: 2.1 time: 0.081225 Oct 27 17:42:55.908314 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 549/1123] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:55 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:56.129480 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-fbaaeb51-3e1c-4e19-ba50-59a9b970bdb0 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:56.130024 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-fbaaeb51-3e1c-4e19-ba50-59a9b970bdb0 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:56.136196 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fbaaeb51-3e1c-4e19-ba50-59a9b970bdb0 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:56.136678 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fbaaeb51-3e1c-4e19-ba50-59a9b970bdb0 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:56.137114 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fbaaeb51-3e1c-4e19-ba50-59a9b970bdb0 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:56.137798 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fbaaeb51-3e1c-4e19-ba50-59a9b970bdb0 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:56.138251 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fbaaeb51-3e1c-4e19-ba50-59a9b970bdb0 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:56.138674 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-fbaaeb51-3e1c-4e19-ba50-59a9b970bdb0 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:56.269351 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-fbaaeb51-3e1c-4e19-ba50-59a9b970bdb0 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:56.276963 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-fbaaeb51-3e1c-4e19-ba50-59a9b970bdb0 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 200 len: 1502 microversion: 2.1 time: 0.151533 Oct 27 17:42:56.277534 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 575/1124] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:56 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:56.930386 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-540703bf-8cc1-4a79-8f6e-eaeaa30d3684 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:56.930926 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-540703bf-8cc1-4a79-8f6e-eaeaa30d3684 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:56.938662 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-540703bf-8cc1-4a79-8f6e-eaeaa30d3684 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:56.939235 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-540703bf-8cc1-4a79-8f6e-eaeaa30d3684 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:56.939666 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-540703bf-8cc1-4a79-8f6e-eaeaa30d3684 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:56.940695 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-540703bf-8cc1-4a79-8f6e-eaeaa30d3684 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:56.941145 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-540703bf-8cc1-4a79-8f6e-eaeaa30d3684 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:56.941563 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-540703bf-8cc1-4a79-8f6e-eaeaa30d3684 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:57.003837 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-540703bf-8cc1-4a79-8f6e-eaeaa30d3684 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:57.011613 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-540703bf-8cc1-4a79-8f6e-eaeaa30d3684 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1214 microversion: 2.1 time: 0.085134 Oct 27 17:42:57.012220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 550/1125] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:56 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:57.300946 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-27aa849c-ab1c-42d5-aa61-3d353a42926d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:57.301558 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-27aa849c-ab1c-42d5-aa61-3d353a42926d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:57.307976 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-27aa849c-ab1c-42d5-aa61-3d353a42926d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:57.308461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-27aa849c-ab1c-42d5-aa61-3d353a42926d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:57.308893 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-27aa849c-ab1c-42d5-aa61-3d353a42926d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:57.309579 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-27aa849c-ab1c-42d5-aa61-3d353a42926d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:57.310032 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-27aa849c-ab1c-42d5-aa61-3d353a42926d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:57.310442 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-27aa849c-ab1c-42d5-aa61-3d353a42926d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:57.440590 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-27aa849c-ab1c-42d5-aa61-3d353a42926d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:57.448136 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-27aa849c-ab1c-42d5-aa61-3d353a42926d tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 200 len: 1502 microversion: 2.1 time: 0.151582 Oct 27 17:42:57.448698 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 576/1126] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:57 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:58.035857 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3959761f-b8b6-4077-91a9-a60a5d779a28 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:58.036509 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-3959761f-b8b6-4077-91a9-a60a5d779a28 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:58.043148 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3959761f-b8b6-4077-91a9-a60a5d779a28 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:58.043684 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3959761f-b8b6-4077-91a9-a60a5d779a28 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:58.044130 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3959761f-b8b6-4077-91a9-a60a5d779a28 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:58.044831 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3959761f-b8b6-4077-91a9-a60a5d779a28 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:58.045278 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3959761f-b8b6-4077-91a9-a60a5d779a28 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:58.045696 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3959761f-b8b6-4077-91a9-a60a5d779a28 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:58.048694 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:42:58.252233 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-3959761f-b8b6-4077-91a9-a60a5d779a28 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:58.259949 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-3959761f-b8b6-4077-91a9-a60a5d779a28 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1276 microversion: 2.1 time: 0.228638 Oct 27 17:42:58.260523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 551/1127] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:58 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1276 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:58.470487 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-9b9eaa7a-7fe4-48a9-97a5-6fdfbb426208 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:58.471091 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-9b9eaa7a-7fe4-48a9-97a5-6fdfbb426208 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:58.477698 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9b9eaa7a-7fe4-48a9-97a5-6fdfbb426208 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:58.478179 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9b9eaa7a-7fe4-48a9-97a5-6fdfbb426208 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:58.478609 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9b9eaa7a-7fe4-48a9-97a5-6fdfbb426208 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:58.479292 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9b9eaa7a-7fe4-48a9-97a5-6fdfbb426208 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:58.479759 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9b9eaa7a-7fe4-48a9-97a5-6fdfbb426208 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:58.480180 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-9b9eaa7a-7fe4-48a9-97a5-6fdfbb426208 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:58.620896 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-9b9eaa7a-7fe4-48a9-97a5-6fdfbb426208 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b3b8a1d378d48cd9c35d1f25dc21efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf2026fb6e24bd68a5bd2854b213436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:58.629714 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-9b9eaa7a-7fe4-48a9-97a5-6fdfbb426208 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 200 len: 1502 microversion: 2.1 time: 0.163144 Oct 27 17:42:58.630282 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 577/1128] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:58 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:58.816423 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-61057070-b277-4228-b412-d6ffc83f13fd req-1bf8b045-1217-47af-9096-97e313da1a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa1db3bd-e218-425e-ad45-9c0a80cb40cd", "name": "network-vif-deleted", "tag": "78a1b310-ac20-45b1-a456-852d870f0840"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:42:58.827189 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-61057070-b277-4228-b412-d6ffc83f13fd req-1bf8b045-1217-47af-9096-97e313da1a19 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:58.827671 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-61057070-b277-4228-b412-d6ffc83f13fd req-1bf8b045-1217-47af-9096-97e313da1a19 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:58.828125 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-61057070-b277-4228-b412-d6ffc83f13fd req-1bf8b045-1217-47af-9096-97e313da1a19 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:58.841774 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-61057070-b277-4228-b412-d6ffc83f13fd req-1bf8b045-1217-47af-9096-97e313da1a19 service nova] Creating event network-vif-deleted:78a1b310-ac20-45b1-a456-852d870f0840 for instance aa1db3bd-e218-425e-ad45-9c0a80cb40cd on hv-cinder-86283 Oct 27 17:42:58.846783 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-61057070-b277-4228-b412-d6ffc83f13fd req-1bf8b045-1217-47af-9096-97e313da1a19 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034884 Oct 27 17:42:58.847384 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 552/1129] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:42:59.284265 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d9ab4967-8f6c-4a67-b681-3d229f8a7389 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:59.284879 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d9ab4967-8f6c-4a67-b681-3d229f8a7389 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:59.286898 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:42:59.292062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d9ab4967-8f6c-4a67-b681-3d229f8a7389 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:59.292548 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d9ab4967-8f6c-4a67-b681-3d229f8a7389 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:59.292980 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d9ab4967-8f6c-4a67-b681-3d229f8a7389 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:59.293673 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d9ab4967-8f6c-4a67-b681-3d229f8a7389 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:59.294205 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d9ab4967-8f6c-4a67-b681-3d229f8a7389 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:59.294599 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d9ab4967-8f6c-4a67-b681-3d229f8a7389 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:59.446168 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d9ab4967-8f6c-4a67-b681-3d229f8a7389 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:42:59.454146 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d9ab4967-8f6c-4a67-b681-3d229f8a7389 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1318 microversion: 2.1 time: 0.174326 Oct 27 17:42:59.454729 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 578/1130] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:59 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:42:59.655906 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7010c7ee-42c6-42b2-895c-749ebdb7c546 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:42:59.657184 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7010c7ee-42c6-42b2-895c-749ebdb7c546 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] [instance: aa1db3bd-e218-425e-ad45-9c0a80cb40cd] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:42:59.663756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7010c7ee-42c6-42b2-895c-749ebdb7c546 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:59.664236 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7010c7ee-42c6-42b2-895c-749ebdb7c546 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:59.664659 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7010c7ee-42c6-42b2-895c-749ebdb7c546 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:59.665350 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7010c7ee-42c6-42b2-895c-749ebdb7c546 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:42:59.665792 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7010c7ee-42c6-42b2-895c-749ebdb7c546 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:42:59.666204 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7010c7ee-42c6-42b2-895c-749ebdb7c546 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:42:59.679599 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-7010c7ee-42c6-42b2-895c-749ebdb7c546 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] HTTP exception thrown: Instance aa1db3bd-e218-425e-ad45-9c0a80cb40cd could not be found. Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7010c7ee-42c6-42b2-895c-749ebdb7c546 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Request method failure captured: Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd HTTP/1.1 Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsLsxE94KUdKXzy_idpQhszvmXsAXMlr6lfiIS0_1fCNnjHz0Jwiqb5YNRxXG8EpOn1qFhWtbXiDf-46WuYe-JC8XMOt-kFiOmgr2JDIo0T1xiF0ag2kru6VttyIb3zuJjhclcodXe-D6TO4U9a8Cojn-8RSq1ptju6Ey5p_phjznfg Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: 0bf2026fb6e24bd68a5bd2854b213436 Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-VolumesActionsTest-1738971915 Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:42:59.681592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:42:59.683601 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0bf2026fb6e24bd68a5bd2854b213436"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bf2026fb6e24bd68a5bd2854b213436"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0bf2026fb6e24bd68a5bd2854b213436"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0bf2026fb6e24bd68a5bd2854b213436"}]}] Oct 27 17:42:59.683601 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-VolumesActionsTest-1738971915 Oct 27 17:42:59.683601 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: 0bf2026fb6e24bd68a5bd2854b213436 Oct 27 17:42:59.683601 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-VolumesActionsTest-1738971915 Oct 27 17:42:59.683601 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-VolumesActionsTest-1738971915-project Oct 27 17:42:59.683601 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:42:59.683601 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:42:59.683601 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 9b3b8a1d378d48cd9c35d1f25dc21efe Oct 27 17:42:59.683601 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-VolumesActionsTest-1738971915-project Oct 27 17:42:59.683601 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:42:59.683601 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance aa1db3bd-e218-425e-ad45-9c0a80cb40cd could not be found. Oct 27 17:42:59.683601 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': 'aa1db3bd-e218-425e-ad45-9c0a80cb40cd'} Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa1db3bd-e218-425e-ad45-9c0a80cb40cd could not be found. Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:42:59.684677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa1db3bd-e218-425e-ad45-9c0a80cb40cd could not be found. Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa1db3bd-e218-425e-ad45-9c0a80cb40cd could not be found. Oct 27 17:42:59.686183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:42:59.687576 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7010c7ee-42c6-42b2-895c-749ebdb7c546 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] Returning 404 to user: Instance aa1db3bd-e218-425e-ad45-9c0a80cb40cd could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:42:59.687576 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7010c7ee-42c6-42b2-895c-749ebdb7c546 tempest-VolumesActionsTest-1738971915 tempest-VolumesActionsTest-1738971915-project] 10.222.0.36 "GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd" status: 404 len: 111 microversion: 2.1 time: 0.031802 Oct 27 17:42:59.687576 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 553/1131] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:42:59 2022] GET /compute/v2.1/servers/aa1db3bd-e218-425e-ad45-9c0a80cb40cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:43:00.478062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5072590f-35c3-489e-98bf-481ab6f77e16 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:00.478717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-5072590f-35c3-489e-98bf-481ab6f77e16 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:00.486356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5072590f-35c3-489e-98bf-481ab6f77e16 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:00.486852 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5072590f-35c3-489e-98bf-481ab6f77e16 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:00.487289 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5072590f-35c3-489e-98bf-481ab6f77e16 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:00.488410 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5072590f-35c3-489e-98bf-481ab6f77e16 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:00.488899 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5072590f-35c3-489e-98bf-481ab6f77e16 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:00.489285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5072590f-35c3-489e-98bf-481ab6f77e16 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:00.670015 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-5072590f-35c3-489e-98bf-481ab6f77e16 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:00.678704 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5072590f-35c3-489e-98bf-481ab6f77e16 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1318 microversion: 2.1 time: 0.205162 Oct 27 17:43:00.679280 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 579/1132] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:00 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:00.862180 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-6511ca3a-56d0-4906-8303-945047ccaa0e req-4ef0b096-4ff6-4400-86bf-87d693e30567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53b2a09a-71b7-42d7-8a12-471e65596189", "tag": "20db09b9-b160-41f7-9d9b-06c3145fffc2"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:43:00.867966 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:43:00.873778 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-6511ca3a-56d0-4906-8303-945047ccaa0e req-4ef0b096-4ff6-4400-86bf-87d693e30567 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:00.874256 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-6511ca3a-56d0-4906-8303-945047ccaa0e req-4ef0b096-4ff6-4400-86bf-87d693e30567 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:00.874729 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-6511ca3a-56d0-4906-8303-945047ccaa0e req-4ef0b096-4ff6-4400-86bf-87d693e30567 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:00.888260 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-6511ca3a-56d0-4906-8303-945047ccaa0e req-4ef0b096-4ff6-4400-86bf-87d693e30567 service nova] Creating event network-changed:20db09b9-b160-41f7-9d9b-06c3145fffc2 for instance 53b2a09a-71b7-42d7-8a12-471e65596189 on hv-cinder-86283 Oct 27 17:43:00.893366 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-6511ca3a-56d0-4906-8303-945047ccaa0e req-4ef0b096-4ff6-4400-86bf-87d693e30567 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035511 Oct 27 17:43:00.894066 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 554/1133] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:43:01.701044 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f6d63088-25b0-438d-9ffb-0b43f95da8ec tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:01.701658 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f6d63088-25b0-438d-9ffb-0b43f95da8ec tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:01.708700 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f6d63088-25b0-438d-9ffb-0b43f95da8ec tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:01.709181 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f6d63088-25b0-438d-9ffb-0b43f95da8ec tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:01.709615 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f6d63088-25b0-438d-9ffb-0b43f95da8ec tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:01.710302 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f6d63088-25b0-438d-9ffb-0b43f95da8ec tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:01.710760 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f6d63088-25b0-438d-9ffb-0b43f95da8ec tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:01.711185 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f6d63088-25b0-438d-9ffb-0b43f95da8ec tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:01.842339 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f6d63088-25b0-438d-9ffb-0b43f95da8ec tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:01.850218 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f6d63088-25b0-438d-9ffb-0b43f95da8ec tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1318 microversion: 2.1 time: 0.153079 Oct 27 17:43:01.850782 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 580/1134] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:01 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:02.874336 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e3e09fd8-8397-484e-a8ab-13dd9f45e54d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:02.875504 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e3e09fd8-8397-484e-a8ab-13dd9f45e54d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:02.881908 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3e09fd8-8397-484e-a8ab-13dd9f45e54d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:02.882387 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3e09fd8-8397-484e-a8ab-13dd9f45e54d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:02.882814 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3e09fd8-8397-484e-a8ab-13dd9f45e54d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:02.883489 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3e09fd8-8397-484e-a8ab-13dd9f45e54d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:02.883979 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3e09fd8-8397-484e-a8ab-13dd9f45e54d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:02.884401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e3e09fd8-8397-484e-a8ab-13dd9f45e54d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:03.010119 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e3e09fd8-8397-484e-a8ab-13dd9f45e54d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:03.018360 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e3e09fd8-8397-484e-a8ab-13dd9f45e54d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1318 microversion: 2.1 time: 0.149050 Oct 27 17:43:03.018917 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 555/1135] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:02 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:04.041011 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b4b38cf1-4567-4f5a-936a-edcf524cee18 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:04.041631 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b4b38cf1-4567-4f5a-936a-edcf524cee18 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:04.043983 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:43:04.044780 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=6 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:43:04.050454 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b4b38cf1-4567-4f5a-936a-edcf524cee18 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:04.050931 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b4b38cf1-4567-4f5a-936a-edcf524cee18 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:04.051364 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b4b38cf1-4567-4f5a-936a-edcf524cee18 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:04.052072 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b4b38cf1-4567-4f5a-936a-edcf524cee18 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:04.052526 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b4b38cf1-4567-4f5a-936a-edcf524cee18 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:04.052950 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b4b38cf1-4567-4f5a-936a-edcf524cee18 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:04.180640 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-b4b38cf1-4567-4f5a-936a-edcf524cee18 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:04.188280 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b4b38cf1-4567-4f5a-936a-edcf524cee18 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1318 microversion: 2.1 time: 0.151157 Oct 27 17:43:04.188846 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 581/1136] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:04 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:05.210907 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-83d2abc8-81ca-4108-9696-330355b62871 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:05.211511 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-83d2abc8-81ca-4108-9696-330355b62871 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:05.213903 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=2 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:43:05.219111 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83d2abc8-81ca-4108-9696-330355b62871 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:05.219585 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83d2abc8-81ca-4108-9696-330355b62871 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:05.220039 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83d2abc8-81ca-4108-9696-330355b62871 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:05.220718 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83d2abc8-81ca-4108-9696-330355b62871 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:05.221165 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83d2abc8-81ca-4108-9696-330355b62871 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:05.221584 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-83d2abc8-81ca-4108-9696-330355b62871 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:05.350896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-83d2abc8-81ca-4108-9696-330355b62871 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:05.358511 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-83d2abc8-81ca-4108-9696-330355b62871 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1318 microversion: 2.1 time: 0.151379 Oct 27 17:43:05.359023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 556/1137] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:05 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:06.383344 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-669f29a2-9974-4055-8afc-eec7f6438773 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:06.384336 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-669f29a2-9974-4055-8afc-eec7f6438773 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:06.390990 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-669f29a2-9974-4055-8afc-eec7f6438773 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:06.391502 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-669f29a2-9974-4055-8afc-eec7f6438773 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:06.391962 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-669f29a2-9974-4055-8afc-eec7f6438773 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:06.392869 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-669f29a2-9974-4055-8afc-eec7f6438773 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:06.394711 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-669f29a2-9974-4055-8afc-eec7f6438773 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:06.395945 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-669f29a2-9974-4055-8afc-eec7f6438773 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:06.578167 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-669f29a2-9974-4055-8afc-eec7f6438773 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:06.597721 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-669f29a2-9974-4055-8afc-eec7f6438773 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1318 microversion: 2.1 time: 0.219985 Oct 27 17:43:06.601959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 582/1138] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:06 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:07.621581 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9e17442c-1eec-4b2f-a5e2-3bdd6614c803 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:07.622190 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9e17442c-1eec-4b2f-a5e2-3bdd6614c803 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:07.629608 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e17442c-1eec-4b2f-a5e2-3bdd6614c803 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:07.630308 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e17442c-1eec-4b2f-a5e2-3bdd6614c803 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:07.631030 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e17442c-1eec-4b2f-a5e2-3bdd6614c803 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:07.631821 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e17442c-1eec-4b2f-a5e2-3bdd6614c803 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:07.632294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e17442c-1eec-4b2f-a5e2-3bdd6614c803 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:07.632751 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e17442c-1eec-4b2f-a5e2-3bdd6614c803 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:07.785636 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9e17442c-1eec-4b2f-a5e2-3bdd6614c803 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:07.794351 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9e17442c-1eec-4b2f-a5e2-3bdd6614c803 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1318 microversion: 2.1 time: 0.176590 Oct 27 17:43:07.795542 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 557/1139] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:07 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:08.817872 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-68570aa8-d118-4015-ab07-32ca271f27ea tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:08.818478 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-68570aa8-d118-4015-ab07-32ca271f27ea tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:08.825190 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-68570aa8-d118-4015-ab07-32ca271f27ea tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:08.825678 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-68570aa8-d118-4015-ab07-32ca271f27ea tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:08.826110 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-68570aa8-d118-4015-ab07-32ca271f27ea tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:08.826807 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-68570aa8-d118-4015-ab07-32ca271f27ea tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:08.827259 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-68570aa8-d118-4015-ab07-32ca271f27ea tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:08.827679 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-68570aa8-d118-4015-ab07-32ca271f27ea tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:08.833957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:43:08.979019 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-68570aa8-d118-4015-ab07-32ca271f27ea tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:08.988104 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-68570aa8-d118-4015-ab07-32ca271f27ea tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1318 microversion: 2.1 time: 0.173990 Oct 27 17:43:08.991743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 583/1140] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:08 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:09.232000 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-63daba58-db17-440c-b1e4-a4a37a229b87 req-495bc5db-39c2-4007-a417-c43f195241ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b2a09a-71b7-42d7-8a12-471e65596189", "name": "network-vif-plugged", "status": "completed", "tag": "20db09b9-b160-41f7-9d9b-06c3145fffc2"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:43:09.246714 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-63daba58-db17-440c-b1e4-a4a37a229b87 req-495bc5db-39c2-4007-a417-c43f195241ff service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:09.247823 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-63daba58-db17-440c-b1e4-a4a37a229b87 req-495bc5db-39c2-4007-a417-c43f195241ff service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:09.248839 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-63daba58-db17-440c-b1e4-a4a37a229b87 req-495bc5db-39c2-4007-a417-c43f195241ff service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:09.262873 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-63daba58-db17-440c-b1e4-a4a37a229b87 req-495bc5db-39c2-4007-a417-c43f195241ff service nova] Creating event network-vif-plugged:20db09b9-b160-41f7-9d9b-06c3145fffc2 for instance 53b2a09a-71b7-42d7-8a12-471e65596189 on hv-cinder-86283 Oct 27 17:43:09.268678 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-63daba58-db17-440c-b1e4-a4a37a229b87 req-495bc5db-39c2-4007-a417-c43f195241ff service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042188 Oct 27 17:43:09.269957 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 558/1141] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:43:10.011390 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6ac530a2-b8bd-4a2c-bd7b-909c791fb759 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:10.012767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-6ac530a2-b8bd-4a2c-bd7b-909c791fb759 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:10.019335 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6ac530a2-b8bd-4a2c-bd7b-909c791fb759 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:10.019936 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6ac530a2-b8bd-4a2c-bd7b-909c791fb759 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:10.020376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6ac530a2-b8bd-4a2c-bd7b-909c791fb759 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:10.021081 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6ac530a2-b8bd-4a2c-bd7b-909c791fb759 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:10.021529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6ac530a2-b8bd-4a2c-bd7b-909c791fb759 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:10.022143 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6ac530a2-b8bd-4a2c-bd7b-909c791fb759 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:10.163120 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-6ac530a2-b8bd-4a2c-bd7b-909c791fb759 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:10.171694 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6ac530a2-b8bd-4a2c-bd7b-909c791fb759 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1318 microversion: 2.1 time: 0.164034 Oct 27 17:43:10.173000 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 584/1142] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:10 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:11.195429 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9fea5b72-96e0-4c6e-9980-7d176d0018b1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:11.196987 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9fea5b72-96e0-4c6e-9980-7d176d0018b1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:11.206293 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9fea5b72-96e0-4c6e-9980-7d176d0018b1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:11.207275 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9fea5b72-96e0-4c6e-9980-7d176d0018b1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:11.208097 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9fea5b72-96e0-4c6e-9980-7d176d0018b1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:11.209043 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9fea5b72-96e0-4c6e-9980-7d176d0018b1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:11.209560 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9fea5b72-96e0-4c6e-9980-7d176d0018b1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:11.210277 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9fea5b72-96e0-4c6e-9980-7d176d0018b1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:11.366555 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9fea5b72-96e0-4c6e-9980-7d176d0018b1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:11.371091 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9fea5b72-96e0-4c6e-9980-7d176d0018b1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1508 microversion: 2.1 time: 0.179815 Oct 27 17:43:11.371982 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 559/1143] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:11 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:29.602240 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1401396357", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452"}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:43:29.609139 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=13 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:43:29.609802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=11 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:43:29.653380 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.network.neutron [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] validate_networks() for None {{(pid=119047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:43:29.921136 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Flavor limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:43:29.921549 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Image limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:43:29.922014 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Flavor pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:43:29.922416 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Image pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:43:29.922817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:43:29.931985 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:29.932461 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:29.932886 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:29.933605 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:29.934051 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:29.934469 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:29.950572 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Getting quotas for project 857aface6a4c41b2a4f46f384884f8f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:43:29.954297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Getting quotas for user 215f91b38692485486879e859bc9ab23 and project 857aface6a4c41b2a4f46f384884f8f0. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:43:29.964957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Going to run 1 instances... {{(pid=119047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:43:29.967033 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:43:30.011531 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-448cabc2-9882-4c12-b91f-c3b303d79155 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.413638 Oct 27 17:43:30.012215 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 585/1144] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:43:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:43:30.023416 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-fe348c4c-0d00-4004-bb94-5a8576c9e9b1 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:30.024056 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-fe348c4c-0d00-4004-bb94-5a8576c9e9b1 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:30.026725 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=11 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:43:30.027545 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=37 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:43:30.080243 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-fe348c4c-0d00-4004-bb94-5a8576c9e9b1 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215f91b38692485486879e859bc9ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857aface6a4c41b2a4f46f384884f8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:30.088048 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-fe348c4c-0d00-4004-bb94-5a8576c9e9b1 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c" status: 200 len: 1215 microversion: 2.1 time: 0.068563 Oct 27 17:43:30.089350 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 560/1145] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:30 2022] GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:31.113035 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0724e555-2c3e-49c2-9b00-59eff309a06e tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:31.113732 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-0724e555-2c3e-49c2-9b00-59eff309a06e tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:31.120398 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0724e555-2c3e-49c2-9b00-59eff309a06e tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:31.120958 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0724e555-2c3e-49c2-9b00-59eff309a06e tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:31.121707 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0724e555-2c3e-49c2-9b00-59eff309a06e tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:31.122473 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0724e555-2c3e-49c2-9b00-59eff309a06e tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:31.123631 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0724e555-2c3e-49c2-9b00-59eff309a06e tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:31.123631 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0724e555-2c3e-49c2-9b00-59eff309a06e tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:31.187899 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-0724e555-2c3e-49c2-9b00-59eff309a06e tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215f91b38692485486879e859bc9ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857aface6a4c41b2a4f46f384884f8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:31.195661 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0724e555-2c3e-49c2-9b00-59eff309a06e tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c" status: 200 len: 1275 microversion: 2.1 time: 0.087386 Oct 27 17:43:31.202177 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 586/1146] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:31 2022] GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c => generated 1275 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:32.220911 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9bfc314b-b201-4270-b737-2b7730a74111 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:32.221534 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9bfc314b-b201-4270-b737-2b7730a74111 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:32.233627 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9bfc314b-b201-4270-b737-2b7730a74111 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:32.234124 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9bfc314b-b201-4270-b737-2b7730a74111 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:32.234563 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9bfc314b-b201-4270-b737-2b7730a74111 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:32.235267 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9bfc314b-b201-4270-b737-2b7730a74111 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:32.235736 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9bfc314b-b201-4270-b737-2b7730a74111 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:32.236173 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9bfc314b-b201-4270-b737-2b7730a74111 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:32.453649 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9bfc314b-b201-4270-b737-2b7730a74111 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215f91b38692485486879e859bc9ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857aface6a4c41b2a4f46f384884f8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:32.465832 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9bfc314b-b201-4270-b737-2b7730a74111 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c" status: 200 len: 1315 microversion: 2.1 time: 0.248926 Oct 27 17:43:32.466421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 561/1147] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:32 2022] GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:32.761722 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-5f74203c-6f75-4497-8b91-8ccf1d816518 req-0fdd0f12-b054-4530-9723-1419b46820ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59874570-fb81-47ad-a9a2-02846069167c", "tag": "ebd91884-7aef-4cbb-9587-f80171d55773"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:43:32.773927 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-5f74203c-6f75-4497-8b91-8ccf1d816518 req-0fdd0f12-b054-4530-9723-1419b46820ad service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:32.774399 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-5f74203c-6f75-4497-8b91-8ccf1d816518 req-0fdd0f12-b054-4530-9723-1419b46820ad service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:32.774824 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-5f74203c-6f75-4497-8b91-8ccf1d816518 req-0fdd0f12-b054-4530-9723-1419b46820ad service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:32.785601 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-5f74203c-6f75-4497-8b91-8ccf1d816518 req-0fdd0f12-b054-4530-9723-1419b46820ad service nova] Creating event network-changed:ebd91884-7aef-4cbb-9587-f80171d55773 for instance 59874570-fb81-47ad-a9a2-02846069167c on hv-cinder-86283 Oct 27 17:43:32.790439 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-5f74203c-6f75-4497-8b91-8ccf1d816518 req-0fdd0f12-b054-4530-9723-1419b46820ad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033036 Oct 27 17:43:32.791053 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 587/1148] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:43:33.488950 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-79d267f4-e4eb-45b3-ba40-4ee93329cf6a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:33.490262 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-79d267f4-e4eb-45b3-ba40-4ee93329cf6a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:33.496796 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-79d267f4-e4eb-45b3-ba40-4ee93329cf6a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:33.497278 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-79d267f4-e4eb-45b3-ba40-4ee93329cf6a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:33.497713 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-79d267f4-e4eb-45b3-ba40-4ee93329cf6a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:33.498454 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-79d267f4-e4eb-45b3-ba40-4ee93329cf6a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:33.498854 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-79d267f4-e4eb-45b3-ba40-4ee93329cf6a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:33.499276 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-79d267f4-e4eb-45b3-ba40-4ee93329cf6a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:33.636269 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-79d267f4-e4eb-45b3-ba40-4ee93329cf6a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215f91b38692485486879e859bc9ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857aface6a4c41b2a4f46f384884f8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:33.643905 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-79d267f4-e4eb-45b3-ba40-4ee93329cf6a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c" status: 200 len: 1315 microversion: 2.1 time: 0.158867 Oct 27 17:43:33.644471 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 562/1149] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:33 2022] GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:34.668300 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-6fe5aa69-e004-45fa-8e5e-46a0343d78b6 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:34.669003 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-6fe5aa69-e004-45fa-8e5e-46a0343d78b6 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:34.675115 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6fe5aa69-e004-45fa-8e5e-46a0343d78b6 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:34.675598 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6fe5aa69-e004-45fa-8e5e-46a0343d78b6 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:34.676064 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6fe5aa69-e004-45fa-8e5e-46a0343d78b6 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:34.676753 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6fe5aa69-e004-45fa-8e5e-46a0343d78b6 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:34.677206 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6fe5aa69-e004-45fa-8e5e-46a0343d78b6 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:34.677633 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-6fe5aa69-e004-45fa-8e5e-46a0343d78b6 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:34.806169 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-6fe5aa69-e004-45fa-8e5e-46a0343d78b6 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215f91b38692485486879e859bc9ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857aface6a4c41b2a4f46f384884f8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:34.813799 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-6fe5aa69-e004-45fa-8e5e-46a0343d78b6 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c" status: 200 len: 1315 microversion: 2.1 time: 0.150438 Oct 27 17:43:34.814363 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 588/1150] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:34 2022] GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:35.836693 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-df628ba2-5d82-4bb2-a252-d92afc0ab710 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:35.837298 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-df628ba2-5d82-4bb2-a252-d92afc0ab710 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:35.843687 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-df628ba2-5d82-4bb2-a252-d92afc0ab710 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:35.844200 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-df628ba2-5d82-4bb2-a252-d92afc0ab710 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:35.844641 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-df628ba2-5d82-4bb2-a252-d92afc0ab710 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:35.845326 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-df628ba2-5d82-4bb2-a252-d92afc0ab710 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:35.845775 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-df628ba2-5d82-4bb2-a252-d92afc0ab710 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:35.846196 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-df628ba2-5d82-4bb2-a252-d92afc0ab710 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:35.971675 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-df628ba2-5d82-4bb2-a252-d92afc0ab710 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215f91b38692485486879e859bc9ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857aface6a4c41b2a4f46f384884f8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:35.979873 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-df628ba2-5d82-4bb2-a252-d92afc0ab710 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c" status: 200 len: 1315 microversion: 2.1 time: 0.147631 Oct 27 17:43:35.980440 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 563/1151] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:35 2022] GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:37.001768 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a4014bfb-e1e7-45ab-ab35-51ceb034a42a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:37.002381 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a4014bfb-e1e7-45ab-ab35-51ceb034a42a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:37.008740 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a4014bfb-e1e7-45ab-ab35-51ceb034a42a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:37.009223 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a4014bfb-e1e7-45ab-ab35-51ceb034a42a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:37.009661 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a4014bfb-e1e7-45ab-ab35-51ceb034a42a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:37.010348 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a4014bfb-e1e7-45ab-ab35-51ceb034a42a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:37.010805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a4014bfb-e1e7-45ab-ab35-51ceb034a42a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:37.011225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a4014bfb-e1e7-45ab-ab35-51ceb034a42a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:37.140050 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a4014bfb-e1e7-45ab-ab35-51ceb034a42a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215f91b38692485486879e859bc9ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857aface6a4c41b2a4f46f384884f8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:37.148196 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a4014bfb-e1e7-45ab-ab35-51ceb034a42a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c" status: 200 len: 1315 microversion: 2.1 time: 0.150358 Oct 27 17:43:37.148770 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 589/1152] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:36 2022] GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:37.267452 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-5b2b8601-9991-4133-877c-8fbe398434db tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54804c04-48a1-40ed-b35c-39d77f6fbcf1", "device": "/dev/sdb"}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:43:37.270491 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-5b2b8601-9991-4133-877c-8fbe398434db tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:37.277629 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5b2b8601-9991-4133-877c-8fbe398434db tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:37.278224 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5b2b8601-9991-4133-877c-8fbe398434db tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:37.278626 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5b2b8601-9991-4133-877c-8fbe398434db tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:37.279330 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5b2b8601-9991-4133-877c-8fbe398434db tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:37.279805 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5b2b8601-9991-4133-877c-8fbe398434db tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:37.280432 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5b2b8601-9991-4133-877c-8fbe398434db tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:37.566989 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-5b2b8601-9991-4133-877c-8fbe398434db tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "POST /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303419 Oct 27 17:43:37.567647 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 564/1153] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Oct 27 17:43:37 2022] POST /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:43:38.172297 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-377f23e8-2eee-4fad-a643-a961dfa1ec31 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:38.172819 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-377f23e8-2eee-4fad-a643-a961dfa1ec31 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:38.179817 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-377f23e8-2eee-4fad-a643-a961dfa1ec31 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:38.180227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-377f23e8-2eee-4fad-a643-a961dfa1ec31 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:38.180656 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-377f23e8-2eee-4fad-a643-a961dfa1ec31 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:38.181335 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-377f23e8-2eee-4fad-a643-a961dfa1ec31 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:38.181779 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-377f23e8-2eee-4fad-a643-a961dfa1ec31 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:38.182196 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-377f23e8-2eee-4fad-a643-a961dfa1ec31 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:38.310928 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-377f23e8-2eee-4fad-a643-a961dfa1ec31 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215f91b38692485486879e859bc9ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857aface6a4c41b2a4f46f384884f8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:38.318673 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-377f23e8-2eee-4fad-a643-a961dfa1ec31 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c" status: 200 len: 1315 microversion: 2.1 time: 0.150346 Oct 27 17:43:38.319236 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 590/1154] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:38 2022] GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:39.341633 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-59b1c12a-479f-4d4e-8f89-549a89160d6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:39.342451 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-59b1c12a-479f-4d4e-8f89-549a89160d6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:39.349163 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-59b1c12a-479f-4d4e-8f89-549a89160d6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:39.349649 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-59b1c12a-479f-4d4e-8f89-549a89160d6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:39.350344 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-59b1c12a-479f-4d4e-8f89-549a89160d6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:39.351039 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-59b1c12a-479f-4d4e-8f89-549a89160d6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:39.351485 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-59b1c12a-479f-4d4e-8f89-549a89160d6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:39.351940 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-59b1c12a-479f-4d4e-8f89-549a89160d6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:39.367158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-88c3378b-f198-40b5-b26d-5b78e92297ea req-687740e2-87b5-41ca-9579-8fbf0725c9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59874570-fb81-47ad-a9a2-02846069167c", "name": "network-vif-plugged", "status": "completed", "tag": "ebd91884-7aef-4cbb-9587-f80171d55773"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:43:39.377679 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-88c3378b-f198-40b5-b26d-5b78e92297ea req-687740e2-87b5-41ca-9579-8fbf0725c9d2 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:39.378140 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-88c3378b-f198-40b5-b26d-5b78e92297ea req-687740e2-87b5-41ca-9579-8fbf0725c9d2 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:39.378573 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-88c3378b-f198-40b5-b26d-5b78e92297ea req-687740e2-87b5-41ca-9579-8fbf0725c9d2 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:39.398158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-88c3378b-f198-40b5-b26d-5b78e92297ea req-687740e2-87b5-41ca-9579-8fbf0725c9d2 service nova] Creating event network-vif-plugged:ebd91884-7aef-4cbb-9587-f80171d55773 for instance 59874570-fb81-47ad-a9a2-02846069167c on hv-cinder-86283 Oct 27 17:43:39.403687 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-88c3378b-f198-40b5-b26d-5b78e92297ea req-687740e2-87b5-41ca-9579-8fbf0725c9d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041162 Oct 27 17:43:39.404458 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 591/1155] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:43:39.502034 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-59b1c12a-479f-4d4e-8f89-549a89160d6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215f91b38692485486879e859bc9ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857aface6a4c41b2a4f46f384884f8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:39.511405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-59b1c12a-479f-4d4e-8f89-549a89160d6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c" status: 200 len: 1315 microversion: 2.1 time: 0.174083 Oct 27 17:43:39.512154 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 565/1156] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:39 2022] GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:40.531604 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:43:40.532394 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=6 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:43:40.537179 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-7b1238b8-1142-49a6-afbe-c4bb8d653b85 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:40.537929 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-7b1238b8-1142-49a6-afbe-c4bb8d653b85 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:40.545135 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7b1238b8-1142-49a6-afbe-c4bb8d653b85 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:40.545608 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7b1238b8-1142-49a6-afbe-c4bb8d653b85 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:40.546038 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7b1238b8-1142-49a6-afbe-c4bb8d653b85 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:40.546723 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7b1238b8-1142-49a6-afbe-c4bb8d653b85 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:40.547168 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7b1238b8-1142-49a6-afbe-c4bb8d653b85 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:40.547618 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-7b1238b8-1142-49a6-afbe-c4bb8d653b85 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:40.672748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-7b1238b8-1142-49a6-afbe-c4bb8d653b85 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215f91b38692485486879e859bc9ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857aface6a4c41b2a4f46f384884f8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:40.680808 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-7b1238b8-1142-49a6-afbe-c4bb8d653b85 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c" status: 200 len: 1315 microversion: 2.1 time: 0.150165 Oct 27 17:43:40.681377 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 592/1157] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:40 2022] GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:41.703720 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-b4f93ae9-d1ae-46d7-8c60-be20c4d65530 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:41.704384 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-b4f93ae9-d1ae-46d7-8c60-be20c4d65530 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:41.706876 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=2 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:43:41.714037 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4f93ae9-d1ae-46d7-8c60-be20c4d65530 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:41.714838 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4f93ae9-d1ae-46d7-8c60-be20c4d65530 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:41.715347 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4f93ae9-d1ae-46d7-8c60-be20c4d65530 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:41.716461 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4f93ae9-d1ae-46d7-8c60-be20c4d65530 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:41.717278 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4f93ae9-d1ae-46d7-8c60-be20c4d65530 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:41.717823 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-b4f93ae9-d1ae-46d7-8c60-be20c4d65530 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:41.845953 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-b4f93ae9-d1ae-46d7-8c60-be20c4d65530 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215f91b38692485486879e859bc9ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857aface6a4c41b2a4f46f384884f8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:41.853823 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-b4f93ae9-d1ae-46d7-8c60-be20c4d65530 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c" status: 200 len: 1464 microversion: 2.1 time: 0.153977 Oct 27 17:43:41.854397 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 566/1158] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:41 2022] GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:41.899894 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a7d0ead0-828a-4683-ad34-1617bc67ba6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:41.900380 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a7d0ead0-828a-4683-ad34-1617bc67ba6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:41.906706 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7d0ead0-828a-4683-ad34-1617bc67ba6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:41.907177 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7d0ead0-828a-4683-ad34-1617bc67ba6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:41.907625 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7d0ead0-828a-4683-ad34-1617bc67ba6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:41.908313 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7d0ead0-828a-4683-ad34-1617bc67ba6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:41.908762 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7d0ead0-828a-4683-ad34-1617bc67ba6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:41.909180 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a7d0ead0-828a-4683-ad34-1617bc67ba6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:41.934122 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a7d0ead0-828a-4683-ad34-1617bc67ba6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Going to try to terminate instance {{(pid=119047) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:43:42.009503 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a7d0ead0-828a-4683-ad34-1617bc67ba6d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "DELETE /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c" status: 204 len: 0 microversion: 2.1 time: 0.113703 Oct 27 17:43:42.010399 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 593/1159] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:43:41 2022] DELETE /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:43:42.018795 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-eb20aa7c-072c-48f4-9dd6-bd966fc5a0d8 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:42.019404 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-eb20aa7c-072c-48f4-9dd6-bd966fc5a0d8 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:42.025916 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eb20aa7c-072c-48f4-9dd6-bd966fc5a0d8 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:42.026391 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eb20aa7c-072c-48f4-9dd6-bd966fc5a0d8 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:42.026821 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eb20aa7c-072c-48f4-9dd6-bd966fc5a0d8 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:42.027499 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eb20aa7c-072c-48f4-9dd6-bd966fc5a0d8 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:42.027971 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eb20aa7c-072c-48f4-9dd6-bd966fc5a0d8 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:42.028389 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-eb20aa7c-072c-48f4-9dd6-bd966fc5a0d8 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:42.159077 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-eb20aa7c-072c-48f4-9dd6-bd966fc5a0d8 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215f91b38692485486879e859bc9ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857aface6a4c41b2a4f46f384884f8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:42.166768 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-eb20aa7c-072c-48f4-9dd6-bd966fc5a0d8 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c" status: 200 len: 1470 microversion: 2.1 time: 0.152015 Oct 27 17:43:42.167325 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 567/1160] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:42 2022] GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:43:43.190934 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4dcb0ad0-6706-4758-a7ec-1a9825261882 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:43.191566 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4dcb0ad0-6706-4758-a7ec-1a9825261882 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:43.198530 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dcb0ad0-6706-4758-a7ec-1a9825261882 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:43.199013 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dcb0ad0-6706-4758-a7ec-1a9825261882 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:43.199448 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dcb0ad0-6706-4758-a7ec-1a9825261882 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:43.200184 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dcb0ad0-6706-4758-a7ec-1a9825261882 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:43.200643 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dcb0ad0-6706-4758-a7ec-1a9825261882 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:43.201070 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4dcb0ad0-6706-4758-a7ec-1a9825261882 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:43.326002 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4dcb0ad0-6706-4758-a7ec-1a9825261882 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215f91b38692485486879e859bc9ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857aface6a4c41b2a4f46f384884f8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:43.333598 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4dcb0ad0-6706-4758-a7ec-1a9825261882 tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c" status: 200 len: 1470 microversion: 2.1 time: 0.147001 Oct 27 17:43:43.334167 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 594/1161] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:43 2022] GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:44.357505 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-cc6e000e-c6d2-49e2-9f7e-480b2bcd998d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:44.358142 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-cc6e000e-c6d2-49e2-9f7e-480b2bcd998d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:44.364639 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cc6e000e-c6d2-49e2-9f7e-480b2bcd998d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:44.365115 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cc6e000e-c6d2-49e2-9f7e-480b2bcd998d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:44.365548 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cc6e000e-c6d2-49e2-9f7e-480b2bcd998d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:44.366230 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cc6e000e-c6d2-49e2-9f7e-480b2bcd998d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:44.366698 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cc6e000e-c6d2-49e2-9f7e-480b2bcd998d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:44.367095 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cc6e000e-c6d2-49e2-9f7e-480b2bcd998d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:44.536197 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-cc6e000e-c6d2-49e2-9f7e-480b2bcd998d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215f91b38692485486879e859bc9ab23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857aface6a4c41b2a4f46f384884f8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:43:44.545331 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-cc6e000e-c6d2-49e2-9f7e-480b2bcd998d tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c" status: 200 len: 1470 microversion: 2.1 time: 0.191708 Oct 27 17:43:44.546232 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 568/1162] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:44 2022] GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:43:44.914076 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-d0aff687-e79a-4fd4-aab9-eed084220fd5 req-de3e3791-a68e-4576-b498-d3e764a58240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59874570-fb81-47ad-a9a2-02846069167c", "name": "network-vif-deleted", "tag": "ebd91884-7aef-4cbb-9587-f80171d55773"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:43:44.932055 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-d0aff687-e79a-4fd4-aab9-eed084220fd5 req-de3e3791-a68e-4576-b498-d3e764a58240 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:44.932626 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-d0aff687-e79a-4fd4-aab9-eed084220fd5 req-de3e3791-a68e-4576-b498-d3e764a58240 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:44.933122 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-d0aff687-e79a-4fd4-aab9-eed084220fd5 req-de3e3791-a68e-4576-b498-d3e764a58240 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:44.946091 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-d0aff687-e79a-4fd4-aab9-eed084220fd5 req-de3e3791-a68e-4576-b498-d3e764a58240 service nova] Creating event network-vif-deleted:ebd91884-7aef-4cbb-9587-f80171d55773 for instance 59874570-fb81-47ad-a9a2-02846069167c on hv-cinder-86283 Oct 27 17:43:44.953005 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-d0aff687-e79a-4fd4-aab9-eed084220fd5 req-de3e3791-a68e-4576-b498-d3e764a58240 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043027 Oct 27 17:43:44.954743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 595/1163] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:43:45.571336 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-14587ac7-bf5f-419b-8b5c-1ef42bdb732a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:43:45.571956 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-14587ac7-bf5f-419b-8b5c-1ef42bdb732a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] [instance: 59874570-fb81-47ad-a9a2-02846069167c] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:43:45.579626 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-14587ac7-bf5f-419b-8b5c-1ef42bdb732a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:45.580427 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-14587ac7-bf5f-419b-8b5c-1ef42bdb732a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:45.580563 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-14587ac7-bf5f-419b-8b5c-1ef42bdb732a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:45.581283 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-14587ac7-bf5f-419b-8b5c-1ef42bdb732a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:43:45.582025 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-14587ac7-bf5f-419b-8b5c-1ef42bdb732a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:43:45.582159 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-14587ac7-bf5f-419b-8b5c-1ef42bdb732a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:43:45.596652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-14587ac7-bf5f-419b-8b5c-1ef42bdb732a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] HTTP exception thrown: Instance 59874570-fb81-47ad-a9a2-02846069167c could not be found. Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-14587ac7-bf5f-419b-8b5c-1ef42bdb732a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Request method failure captured: Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c HTTP/1.1 Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsNAU5Uve3xx-0OANqLjbSgwULXDbPIJhAP6wrVnIXD95QTi1XoUQlYw4RKK4kXuFg8CThdpf-0h6AAxbfgMcfjbAGBXjbETA_Yn7KESNjFwiMiuJf54NHmm4kt9UYKO0LlA4ZAQ2GHQB2r65MYl_X89r0zXNZd8q8LoF64pZ4l5WPM Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: 857aface6a4c41b2a4f46f384884f8f0 Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-VolumesNegativeTest-2078357551 Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:43:45.598311 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:43:45.600294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/857aface6a4c41b2a4f46f384884f8f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/857aface6a4c41b2a4f46f384884f8f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_857aface6a4c41b2a4f46f384884f8f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/857aface6a4c41b2a4f46f384884f8f0"}]}] Oct 27 17:43:45.600294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-VolumesNegativeTest-2078357551 Oct 27 17:43:45.600294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: 857aface6a4c41b2a4f46f384884f8f0 Oct 27 17:43:45.600294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-VolumesNegativeTest-2078357551 Oct 27 17:43:45.600294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-VolumesNegativeTest-2078357551-project Oct 27 17:43:45.600294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:43:45.600294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:43:45.600294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 215f91b38692485486879e859bc9ab23 Oct 27 17:43:45.600294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-VolumesNegativeTest-2078357551-project Oct 27 17:43:45.600294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:43:45.600294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance 59874570-fb81-47ad-a9a2-02846069167c could not be found. Oct 27 17:43:45.600294 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '59874570-fb81-47ad-a9a2-02846069167c'} Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59874570-fb81-47ad-a9a2-02846069167c could not be found. Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:43:45.601323 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59874570-fb81-47ad-a9a2-02846069167c could not be found. Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59874570-fb81-47ad-a9a2-02846069167c could not be found. Oct 27 17:43:45.603543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:43:45.604886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-14587ac7-bf5f-419b-8b5c-1ef42bdb732a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] Returning 404 to user: Instance 59874570-fb81-47ad-a9a2-02846069167c could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:43:45.604886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-14587ac7-bf5f-419b-8b5c-1ef42bdb732a tempest-VolumesNegativeTest-2078357551 tempest-VolumesNegativeTest-2078357551-project] 10.222.0.36 "GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c" status: 404 len: 111 microversion: 2.1 time: 0.033159 Oct 27 17:43:45.604886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 569/1164] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:43:45 2022] GET /compute/v2.1/servers/59874570-fb81-47ad-a9a2-02846069167c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 17:44:00.470235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:44:00.470987 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:44:00.670790 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a2587ab6-15bc-492d-9b48-59f846a21d18 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Action: 'create', calling method: .version_select at 0x7f078bf5e9d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1501870066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6WWpR4J19Lgq46GlKsNI/nNnY6eMcLwi/UpElLi/3vZJxVoyf9M3ja0vPcHldUYXC9RQ2LbZf/6sh73ce0FEMCY86apkdjiG2YVCOc6Z68w4/gjMaDlFVyw7UetvQjAQ=="}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:44:00.686927 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-a2587ab6-15bc-492d-9b48-59f846a21d18 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Getting quotas for project e62c12b7398343648a02ef5c64cda2b1. Resources: {'key_pairs'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:44:00.691800 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-a2587ab6-15bc-492d-9b48-59f846a21d18 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Getting quotas for user 7aa8ef56dea147fe9594ac6ae812aebb and project e62c12b7398343648a02ef5c64cda2b1. Resources: {'key_pairs'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:44:00.705075 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a2587ab6-15bc-492d-9b48-59f846a21d18 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [cf99a76b-f71b-4137-83b1-8a37105e1733] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 17:44:01.711359 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO oslo.messaging._drivers.impl_rabbit [None req-a2587ab6-15bc-492d-9b48-59f846a21d18 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [cf99a76b-f71b-4137-83b1-8a37105e1733] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 54398. Oct 27 17:44:01.725264 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a2587ab6-15bc-492d-9b48-59f846a21d18 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.260682 Oct 27 17:44:01.726239 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 596/1165] 10.222.0.36 () {60 vars in 1159 bytes} [Thu Oct 27 17:44:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:44:04.491978 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7fd79753-5d7e-4419-9947-2bba92a16c2f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:04.492488 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7fd79753-5d7e-4419-9947-2bba92a16c2f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:04.495004 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=22 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:44:04.495765 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:44:04.501181 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7fd79753-5d7e-4419-9947-2bba92a16c2f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:04.501666 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7fd79753-5d7e-4419-9947-2bba92a16c2f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:04.502099 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7fd79753-5d7e-4419-9947-2bba92a16c2f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:04.502788 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7fd79753-5d7e-4419-9947-2bba92a16c2f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:04.503240 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7fd79753-5d7e-4419-9947-2bba92a16c2f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:04.503659 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7fd79753-5d7e-4419-9947-2bba92a16c2f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:04.592820 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-7fd79753-5d7e-4419-9947-2bba92a16c2f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lazy-loading 'services' on Instance uuid 53b2a09a-71b7-42d7-8a12-471e65596189 {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:44:04.664493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7fd79753-5d7e-4419-9947-2bba92a16c2f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "DELETE /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189/os-volume_attachments/54804c04-48a1-40ed-b35c-39d77f6fbcf1" status: 202 len: 0 microversion: 2.1 time: 0.176316 Oct 27 17:44:04.665115 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 570/1166] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Oct 27 17:44:04 2022] DELETE /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189/os-volume_attachments/54804c04-48a1-40ed-b35c-39d77f6fbcf1 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:44:05.790448 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-29635558-ecd4-4122-8f21-c19f5e87d910 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:05.791068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-29635558-ecd4-4122-8f21-c19f5e87d910 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:05.801215 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29635558-ecd4-4122-8f21-c19f5e87d910 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:05.801709 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29635558-ecd4-4122-8f21-c19f5e87d910 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:05.802148 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29635558-ecd4-4122-8f21-c19f5e87d910 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:05.802921 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29635558-ecd4-4122-8f21-c19f5e87d910 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:05.803374 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29635558-ecd4-4122-8f21-c19f5e87d910 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:05.803921 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29635558-ecd4-4122-8f21-c19f5e87d910 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:05.830486 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-29635558-ecd4-4122-8f21-c19f5e87d910 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Going to try to terminate instance {{(pid=119047) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:44:05.909653 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-29635558-ecd4-4122-8f21-c19f5e87d910 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "DELETE /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 204 len: 0 microversion: 2.1 time: 0.123414 Oct 27 17:44:05.910483 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 597/1167] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:44:05 2022] DELETE /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:44:05.919664 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-188d1513-f91d-4743-a4b2-12f1fb3c6c8d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:05.920420 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-188d1513-f91d-4743-a4b2-12f1fb3c6c8d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:05.926965 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-188d1513-f91d-4743-a4b2-12f1fb3c6c8d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:05.927446 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-188d1513-f91d-4743-a4b2-12f1fb3c6c8d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:05.927914 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-188d1513-f91d-4743-a4b2-12f1fb3c6c8d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:05.928617 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-188d1513-f91d-4743-a4b2-12f1fb3c6c8d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:05.929059 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-188d1513-f91d-4743-a4b2-12f1fb3c6c8d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:05.929478 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-188d1513-f91d-4743-a4b2-12f1fb3c6c8d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:06.069075 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-188d1513-f91d-4743-a4b2-12f1fb3c6c8d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:06.078753 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-188d1513-f91d-4743-a4b2-12f1fb3c6c8d tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1514 microversion: 2.1 time: 0.163573 Oct 27 17:44:06.079512 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 571/1168] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:05 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:07.103278 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-47c05230-a58b-4940-9e05-bf9b5a636404 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:07.104698 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-47c05230-a58b-4940-9e05-bf9b5a636404 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:07.111754 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-47c05230-a58b-4940-9e05-bf9b5a636404 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:07.112280 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-47c05230-a58b-4940-9e05-bf9b5a636404 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:07.112718 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-47c05230-a58b-4940-9e05-bf9b5a636404 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:07.113457 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-47c05230-a58b-4940-9e05-bf9b5a636404 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:07.113961 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-47c05230-a58b-4940-9e05-bf9b5a636404 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:07.114382 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-47c05230-a58b-4940-9e05-bf9b5a636404 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:07.248622 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-47c05230-a58b-4940-9e05-bf9b5a636404 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:07.256306 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-47c05230-a58b-4940-9e05-bf9b5a636404 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1514 microversion: 2.1 time: 0.158311 Oct 27 17:44:07.256870 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 598/1169] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:07 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:08.279845 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0b91ca7b-25c0-4ca3-9f4d-f3fd507d74e2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:08.280461 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-0b91ca7b-25c0-4ca3-9f4d-f3fd507d74e2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:08.282686 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 17:44:08.282823 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Thu Oct 27 17:44:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 (ip 10.222.0.36) !!! Oct 27 17:44:08.295541 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b91ca7b-25c0-4ca3-9f4d-f3fd507d74e2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:08.296063 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b91ca7b-25c0-4ca3-9f4d-f3fd507d74e2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:08.296495 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b91ca7b-25c0-4ca3-9f4d-f3fd507d74e2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:08.297197 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b91ca7b-25c0-4ca3-9f4d-f3fd507d74e2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:08.297644 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b91ca7b-25c0-4ca3-9f4d-f3fd507d74e2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:08.298060 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0b91ca7b-25c0-4ca3-9f4d-f3fd507d74e2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:08.508717 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0b91ca7b-25c0-4ca3-9f4d-f3fd507d74e2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:08.516466 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0b91ca7b-25c0-4ca3-9f4d-f3fd507d74e2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 200 len: 1514 microversion: 2.1 time: 0.240612 Oct 27 17:44:08.517033 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 572/1170] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:08 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:08.691884 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-1a1dfc39-cafe-4f6b-983b-57bf8d9268ad req-00e4590f-d7ff-49b7-a3bc-0b20b5b6df76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b2a09a-71b7-42d7-8a12-471e65596189", "name": "network-vif-deleted", "tag": "20db09b9-b160-41f7-9d9b-06c3145fffc2"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:44:08.704427 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-1a1dfc39-cafe-4f6b-983b-57bf8d9268ad req-00e4590f-d7ff-49b7-a3bc-0b20b5b6df76 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:08.704907 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-1a1dfc39-cafe-4f6b-983b-57bf8d9268ad req-00e4590f-d7ff-49b7-a3bc-0b20b5b6df76 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:08.705343 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-1a1dfc39-cafe-4f6b-983b-57bf8d9268ad req-00e4590f-d7ff-49b7-a3bc-0b20b5b6df76 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:08.718116 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-1a1dfc39-cafe-4f6b-983b-57bf8d9268ad req-00e4590f-d7ff-49b7-a3bc-0b20b5b6df76 service nova] Creating event network-vif-deleted:20db09b9-b160-41f7-9d9b-06c3145fffc2 for instance 53b2a09a-71b7-42d7-8a12-471e65596189 on hv-cinder-86283 Oct 27 17:44:08.724420 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-1a1dfc39-cafe-4f6b-983b-57bf8d9268ad req-00e4590f-d7ff-49b7-a3bc-0b20b5b6df76 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036181 Oct 27 17:44:08.725335 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 599/1171] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:44:09.539760 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-74147918-1904-4f8e-b49b-eea0bdebded2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:09.540360 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-74147918-1904-4f8e-b49b-eea0bdebded2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 53b2a09a-71b7-42d7-8a12-471e65596189] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:09.547502 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74147918-1904-4f8e-b49b-eea0bdebded2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:09.548143 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74147918-1904-4f8e-b49b-eea0bdebded2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:09.548602 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74147918-1904-4f8e-b49b-eea0bdebded2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:09.549337 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74147918-1904-4f8e-b49b-eea0bdebded2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:09.549783 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74147918-1904-4f8e-b49b-eea0bdebded2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:09.550225 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-74147918-1904-4f8e-b49b-eea0bdebded2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:09.564625 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-74147918-1904-4f8e-b49b-eea0bdebded2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] HTTP exception thrown: Instance 53b2a09a-71b7-42d7-8a12-471e65596189 could not be found. Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-74147918-1904-4f8e-b49b-eea0bdebded2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Request method failure captured: Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 HTTP/1.1 Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsMbRFJr--T7cIJ6r9Z_IBNtqVW1ndcDIBsh80lNjgrSxZE7k_A8PJlCpnt7oJw3uA3sa1I3NPDQXqxh2ZX-KWCQguqbdLWY0KRqhtpSFzhwTnQBD_oGk9c-y8Akfjq-f12JSu-9TgmovG2vLNJ8gjPhJxGUkhNk_zvawQKFAM4iRPY Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: 737d405702b943f1aaab986473bc833d Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1032049549 Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:44:09.566291 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:44:09.567833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/737d405702b943f1aaab986473bc833d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/737d405702b943f1aaab986473bc833d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_737d405702b943f1aaab986473bc833d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/737d405702b943f1aaab986473bc833d"}]}] Oct 27 17:44:09.567833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-VolumesSnapshotTestJSON-1032049549 Oct 27 17:44:09.567833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: 737d405702b943f1aaab986473bc833d Oct 27 17:44:09.567833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1032049549 Oct 27 17:44:09.567833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-VolumesSnapshotTestJSON-1032049549-project Oct 27 17:44:09.567833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:44:09.567833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:44:09.567833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: a6295a8005ea40ffb4d48cf86bb3c626 Oct 27 17:44:09.567833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-VolumesSnapshotTestJSON-1032049549-project Oct 27 17:44:09.567833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:44:09.567833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance 53b2a09a-71b7-42d7-8a12-471e65596189 could not be found. Oct 27 17:44:09.567833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '53b2a09a-71b7-42d7-8a12-471e65596189'} Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53b2a09a-71b7-42d7-8a12-471e65596189 could not be found. Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:44:09.569707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53b2a09a-71b7-42d7-8a12-471e65596189 could not be found. Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53b2a09a-71b7-42d7-8a12-471e65596189 could not be found. Oct 27 17:44:09.571630 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:44:09.573316 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-74147918-1904-4f8e-b49b-eea0bdebded2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Returning 404 to user: Instance 53b2a09a-71b7-42d7-8a12-471e65596189 could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:44:09.573316 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-74147918-1904-4f8e-b49b-eea0bdebded2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189" status: 404 len: 111 microversion: 2.1 time: 0.032433 Oct 27 17:44:09.573316 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 573/1172] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:09 2022] GET /compute/v2.1/servers/53b2a09a-71b7-42d7-8a12-471e65596189 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:44:28.875380 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=4 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:44:28.876249 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:44:28.877226 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:44:28.882335 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1041910579", "imageRef": "98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83", "flavorRef": "452", "networks": [{"uuid": "29be1e99-94b7-4b54-bbe7-329fba4bbba4"}]}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:44:28.938706 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.network.neutron [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] validate_networks() for [('29be1e99-94b7-4b54-bbe7-329fba4bbba4', None, None, None, None, None)] {{(pid=119047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:44:29.272319 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Flavor limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:44:29.272744 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Image limits 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:44:29.273219 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Flavor pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:44:29.273653 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Image pref 0:0:0 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:44:29.274066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.virt.hardware [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:44:29.282884 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:29.283367 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:29.283829 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:29.284572 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:29.285027 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:29.285454 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:29.303180 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Getting quotas for project 737d405702b943f1aaab986473bc833d. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:44:29.307670 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.quota [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Getting quotas for user a6295a8005ea40ffb4d48cf86bb3c626 and project 737d405702b943f1aaab986473bc833d. Resources: {'instances', 'cores', 'ram'} {{(pid=119047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:44:29.318680 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Going to run 1 instances... {{(pid=119047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:44:29.321109 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98e60f0c-c8d3-4ec1-85f2-cb7a0080aa83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:44:29.367421 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c9627357-303a-41b4-bac8-c4af07a2218f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493456 Oct 27 17:44:29.368114 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 600/1173] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:44:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:44:29.379050 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-02f82ab7-f8ab-4676-a0a1-e255d356d4af tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:29.380263 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-02f82ab7-f8ab-4676-a0a1-e255d356d4af tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:29.382695 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=8 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:44:29.383728 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:44:29.454880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-02f82ab7-f8ab-4676-a0a1-e255d356d4af tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:29.463007 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-02f82ab7-f8ab-4676-a0a1-e255d356d4af tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 200 len: 1219 microversion: 2.1 time: 0.087504 Oct 27 17:44:29.471877 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 574/1174] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:29 2022] GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:30.486053 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-094ca4a7-e533-4791-9945-483c43cdbdba tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:30.486665 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-094ca4a7-e533-4791-9945-483c43cdbdba tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:30.494385 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-094ca4a7-e533-4791-9945-483c43cdbdba tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:30.494856 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-094ca4a7-e533-4791-9945-483c43cdbdba tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:30.495284 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-094ca4a7-e533-4791-9945-483c43cdbdba tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:30.496001 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-094ca4a7-e533-4791-9945-483c43cdbdba tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:30.496449 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-094ca4a7-e533-4791-9945-483c43cdbdba tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:30.496865 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-094ca4a7-e533-4791-9945-483c43cdbdba tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:30.559847 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-094ca4a7-e533-4791-9945-483c43cdbdba tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:30.567459 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-094ca4a7-e533-4791-9945-483c43cdbdba tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 200 len: 1271 microversion: 2.1 time: 0.085356 Oct 27 17:44:30.568064 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 601/1175] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:30 2022] GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:31.590589 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-adf9b4a6-5922-404c-90ce-78ba49190edf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:31.591226 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-adf9b4a6-5922-404c-90ce-78ba49190edf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:31.598537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-adf9b4a6-5922-404c-90ce-78ba49190edf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:31.599008 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-adf9b4a6-5922-404c-90ce-78ba49190edf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:31.599438 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-adf9b4a6-5922-404c-90ce-78ba49190edf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:31.600137 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-adf9b4a6-5922-404c-90ce-78ba49190edf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:31.600582 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-adf9b4a6-5922-404c-90ce-78ba49190edf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:31.601152 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-adf9b4a6-5922-404c-90ce-78ba49190edf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:31.842968 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-adf9b4a6-5922-404c-90ce-78ba49190edf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:31.850599 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-adf9b4a6-5922-404c-90ce-78ba49190edf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 200 len: 1319 microversion: 2.1 time: 0.264293 Oct 27 17:44:31.860707 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 575/1176] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:31 2022] GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:32.297547 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-16b35bbe-b436-4ac9-8755-2d659ca6f711 req-aea14af2-b0e3-43e1-a571-4efdc8b8d26c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40b2189c-92c2-47aa-bcd5-579ede2f5b96", "tag": "8c6c9aed-3c9f-4c5c-814b-b0fc0027ed3f"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:44:32.309895 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-16b35bbe-b436-4ac9-8755-2d659ca6f711 req-aea14af2-b0e3-43e1-a571-4efdc8b8d26c service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:32.310906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-16b35bbe-b436-4ac9-8755-2d659ca6f711 req-aea14af2-b0e3-43e1-a571-4efdc8b8d26c service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:32.311423 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-16b35bbe-b436-4ac9-8755-2d659ca6f711 req-aea14af2-b0e3-43e1-a571-4efdc8b8d26c service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:32.322699 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-16b35bbe-b436-4ac9-8755-2d659ca6f711 req-aea14af2-b0e3-43e1-a571-4efdc8b8d26c service nova] Creating event network-changed:8c6c9aed-3c9f-4c5c-814b-b0fc0027ed3f for instance 40b2189c-92c2-47aa-bcd5-579ede2f5b96 on hv-cinder-86283 Oct 27 17:44:32.327548 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-16b35bbe-b436-4ac9-8755-2d659ca6f711 req-aea14af2-b0e3-43e1-a571-4efdc8b8d26c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034909 Oct 27 17:44:32.328214 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 602/1177] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:44:32.873788 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-30b2ccd0-56e7-4acd-8ddb-3219554cf955 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:32.874328 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-30b2ccd0-56e7-4acd-8ddb-3219554cf955 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:32.880664 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-30b2ccd0-56e7-4acd-8ddb-3219554cf955 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:32.881137 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-30b2ccd0-56e7-4acd-8ddb-3219554cf955 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:32.881571 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-30b2ccd0-56e7-4acd-8ddb-3219554cf955 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:32.882248 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-30b2ccd0-56e7-4acd-8ddb-3219554cf955 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:32.883202 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-30b2ccd0-56e7-4acd-8ddb-3219554cf955 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:32.883623 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-30b2ccd0-56e7-4acd-8ddb-3219554cf955 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:33.011041 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-30b2ccd0-56e7-4acd-8ddb-3219554cf955 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:33.018582 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-30b2ccd0-56e7-4acd-8ddb-3219554cf955 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 200 len: 1319 microversion: 2.1 time: 0.148790 Oct 27 17:44:33.019147 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 576/1178] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:32 2022] GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:34.043776 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-61067475-04ad-4c75-becf-97ac3f0f3487 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:34.044474 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-61067475-04ad-4c75-becf-97ac3f0f3487 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:34.050701 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61067475-04ad-4c75-becf-97ac3f0f3487 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:34.051171 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61067475-04ad-4c75-becf-97ac3f0f3487 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:34.051601 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61067475-04ad-4c75-becf-97ac3f0f3487 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:34.052372 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61067475-04ad-4c75-becf-97ac3f0f3487 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:34.052821 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61067475-04ad-4c75-becf-97ac3f0f3487 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:34.053235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-61067475-04ad-4c75-becf-97ac3f0f3487 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:34.181964 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-61067475-04ad-4c75-becf-97ac3f0f3487 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:34.189591 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-61067475-04ad-4c75-becf-97ac3f0f3487 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 200 len: 1319 microversion: 2.1 time: 0.151532 Oct 27 17:44:34.190155 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 603/1179] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:34 2022] GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:34.851170 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1364636776", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1501870066", "security_groups": [{"name": "tempest-secgroup-smoke-1378820443"}], "block_device_mapping_v2": [{"uuid": "3c400c3e-40a6-4b7c-a956-2f6c7298b9a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cacaec05-05b8-4422-92f4-e7ab38239f98"}]}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:44:34.962220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.network.neutron [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] validate_networks() for [('cacaec05-05b8-4422-92f4-e7ab38239f98', None, None, None, None, None)] {{(pid=119046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:44:35.212816 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-67ca6ef9-e516-4bb3-ab2f-a7ca4616d27c tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:35.213535 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-67ca6ef9-e516-4bb3-ab2f-a7ca4616d27c tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:35.220178 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67ca6ef9-e516-4bb3-ab2f-a7ca4616d27c tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:35.220658 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67ca6ef9-e516-4bb3-ab2f-a7ca4616d27c tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:35.221093 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67ca6ef9-e516-4bb3-ab2f-a7ca4616d27c tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:35.221787 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67ca6ef9-e516-4bb3-ab2f-a7ca4616d27c tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:35.222238 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67ca6ef9-e516-4bb3-ab2f-a7ca4616d27c tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:35.222660 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-67ca6ef9-e516-4bb3-ab2f-a7ca4616d27c tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:35.323037 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Flavor limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:44:35.323486 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Image limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:44:35.324006 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Flavor pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:44:35.324434 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Image pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:44:35.324868 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:44:35.335207 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:35.335685 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:35.336638 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:35.337494 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:35.337941 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:35.338357 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:35.357172 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Getting quotas for project e62c12b7398343648a02ef5c64cda2b1. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:44:35.361581 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Getting quotas for user 7aa8ef56dea147fe9594ac6ae812aebb and project e62c12b7398343648a02ef5c64cda2b1. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:44:35.362866 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-67ca6ef9-e516-4bb3-ab2f-a7ca4616d27c tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:35.371986 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-67ca6ef9-e516-4bb3-ab2f-a7ca4616d27c tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 200 len: 1319 microversion: 2.1 time: 0.162715 Oct 27 17:44:35.372650 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 604/1180] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:35 2022] GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:44:35.430857 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Going to run 1 instances... {{(pid=119046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:44:35.434208 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3c400c3e-40a6-4b7c-a956-2f6c7298b9a5',volume_size=None,volume_type=None)] {{(pid=119046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:44:35.562333 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-36594e32-1d5e-4436-aeb0-a0133e83ab19 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.714936 Oct 27 17:44:35.562984 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 577/1181] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:44:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:44:35.574186 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c1a604d2-a384-484b-8fb0-67bee1b268ed tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:35.574791 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c1a604d2-a384-484b-8fb0-67bee1b268ed tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:35.627126 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c1a604d2-a384-484b-8fb0-67bee1b268ed tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:35.633999 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c1a604d2-a384-484b-8fb0-67bee1b268ed tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1095 microversion: 2.1 time: 0.063728 Oct 27 17:44:35.634557 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 605/1182] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:35 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:36.395652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6846a6ce-8723-43e5-afd4-d8ca72faa8cf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:36.396293 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6846a6ce-8723-43e5-afd4-d8ca72faa8cf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:36.403026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6846a6ce-8723-43e5-afd4-d8ca72faa8cf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:36.403509 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6846a6ce-8723-43e5-afd4-d8ca72faa8cf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:36.403969 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6846a6ce-8723-43e5-afd4-d8ca72faa8cf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:36.404661 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6846a6ce-8723-43e5-afd4-d8ca72faa8cf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:36.405111 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6846a6ce-8723-43e5-afd4-d8ca72faa8cf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:36.405535 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6846a6ce-8723-43e5-afd4-d8ca72faa8cf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:36.531258 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-6846a6ce-8723-43e5-afd4-d8ca72faa8cf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:36.538875 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6846a6ce-8723-43e5-afd4-d8ca72faa8cf tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 200 len: 1319 microversion: 2.1 time: 0.147825 Oct 27 17:44:36.539972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 578/1183] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:36 2022] GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:36.656982 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2a28d02f-c3f4-4eac-b823-32200b0ebef8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:36.657575 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2a28d02f-c3f4-4eac-b823-32200b0ebef8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:36.665449 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2a28d02f-c3f4-4eac-b823-32200b0ebef8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:36.665934 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2a28d02f-c3f4-4eac-b823-32200b0ebef8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:36.666372 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2a28d02f-c3f4-4eac-b823-32200b0ebef8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:36.667065 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2a28d02f-c3f4-4eac-b823-32200b0ebef8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:36.667518 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2a28d02f-c3f4-4eac-b823-32200b0ebef8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:36.667966 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-2a28d02f-c3f4-4eac-b823-32200b0ebef8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:36.728799 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2a28d02f-c3f4-4eac-b823-32200b0ebef8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:36.738574 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2a28d02f-c3f4-4eac-b823-32200b0ebef8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1193 microversion: 2.1 time: 0.085301 Oct 27 17:44:36.739002 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 606/1184] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:36 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:37.563537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-5213e690-cb94-4ba4-89b8-b9cd802ccef2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:37.564236 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-5213e690-cb94-4ba4-89b8-b9cd802ccef2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:37.571940 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5213e690-cb94-4ba4-89b8-b9cd802ccef2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:37.581891 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5213e690-cb94-4ba4-89b8-b9cd802ccef2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:37.582371 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5213e690-cb94-4ba4-89b8-b9cd802ccef2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:37.583118 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5213e690-cb94-4ba4-89b8-b9cd802ccef2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:37.583561 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5213e690-cb94-4ba4-89b8-b9cd802ccef2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:37.584312 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-5213e690-cb94-4ba4-89b8-b9cd802ccef2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:37.763877 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-84c13cdf-179d-4c03-9688-3e25fe86cb76 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:37.764752 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-84c13cdf-179d-4c03-9688-3e25fe86cb76 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:37.771671 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84c13cdf-179d-4c03-9688-3e25fe86cb76 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:37.772185 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84c13cdf-179d-4c03-9688-3e25fe86cb76 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:37.772618 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84c13cdf-179d-4c03-9688-3e25fe86cb76 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:37.773317 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84c13cdf-179d-4c03-9688-3e25fe86cb76 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:37.773767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84c13cdf-179d-4c03-9688-3e25fe86cb76 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:37.774188 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-84c13cdf-179d-4c03-9688-3e25fe86cb76 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:37.827288 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-5213e690-cb94-4ba4-89b8-b9cd802ccef2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:37.836397 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-5213e690-cb94-4ba4-89b8-b9cd802ccef2 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 200 len: 1319 microversion: 2.1 time: 0.277949 Oct 27 17:44:37.837297 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 579/1185] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:37 2022] GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:37.909101 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-84c13cdf-179d-4c03-9688-3e25fe86cb76 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:37.917339 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-84c13cdf-179d-4c03-9688-3e25fe86cb76 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1267 microversion: 2.1 time: 0.158244 Oct 27 17:44:37.917907 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 607/1186] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:37 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:38.269274 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-454391d8-e7e7-4764-973c-3a0f23632955 req-137f9d57-0e9f-478a-be9d-3ce8a8578bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd62978f-8c7f-4d02-8742-98a3a867dd4e", "tag": "7c5fa515-d946-464e-a169-1cd450b97264"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:44:38.279632 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-454391d8-e7e7-4764-973c-3a0f23632955 req-137f9d57-0e9f-478a-be9d-3ce8a8578bf8 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:38.281145 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-454391d8-e7e7-4764-973c-3a0f23632955 req-137f9d57-0e9f-478a-be9d-3ce8a8578bf8 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:38.281574 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-454391d8-e7e7-4764-973c-3a0f23632955 req-137f9d57-0e9f-478a-be9d-3ce8a8578bf8 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:38.293444 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-454391d8-e7e7-4764-973c-3a0f23632955 req-137f9d57-0e9f-478a-be9d-3ce8a8578bf8 service nova] Creating event network-changed:7c5fa515-d946-464e-a169-1cd450b97264 for instance cd62978f-8c7f-4d02-8742-98a3a867dd4e on hv-cinder-86283 Oct 27 17:44:38.298295 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-454391d8-e7e7-4764-973c-3a0f23632955 req-137f9d57-0e9f-478a-be9d-3ce8a8578bf8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033476 Oct 27 17:44:38.298888 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 580/1187] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:44:38.860301 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-8e10a63f-4a01-4aa9-ac23-a3149003a3dd tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:38.860991 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-8e10a63f-4a01-4aa9-ac23-a3149003a3dd tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:38.867761 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8e10a63f-4a01-4aa9-ac23-a3149003a3dd tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:38.868273 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8e10a63f-4a01-4aa9-ac23-a3149003a3dd tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:38.868703 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8e10a63f-4a01-4aa9-ac23-a3149003a3dd tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:38.869403 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8e10a63f-4a01-4aa9-ac23-a3149003a3dd tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:38.869861 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8e10a63f-4a01-4aa9-ac23-a3149003a3dd tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:38.870276 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-8e10a63f-4a01-4aa9-ac23-a3149003a3dd tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:38.941276 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-118afd7b-bae7-4e69-a168-9a1591a6ea46 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:38.942588 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-118afd7b-bae7-4e69-a168-9a1591a6ea46 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:38.951090 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-118afd7b-bae7-4e69-a168-9a1591a6ea46 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:38.951785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-118afd7b-bae7-4e69-a168-9a1591a6ea46 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:38.952399 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-118afd7b-bae7-4e69-a168-9a1591a6ea46 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:38.953418 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-118afd7b-bae7-4e69-a168-9a1591a6ea46 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:38.954583 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-118afd7b-bae7-4e69-a168-9a1591a6ea46 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:38.955223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-118afd7b-bae7-4e69-a168-9a1591a6ea46 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:39.005106 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-8e10a63f-4a01-4aa9-ac23-a3149003a3dd tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:39.013829 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-8e10a63f-4a01-4aa9-ac23-a3149003a3dd tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 200 len: 1319 microversion: 2.1 time: 0.157299 Oct 27 17:44:39.027899 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 608/1188] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:38 2022] GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:39.035323 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-42ebd546-5516-4770-9d2c-d8e658899386 req-a2d23056-ea23-4c75-b1ad-be09d44db9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b2189c-92c2-47aa-bcd5-579ede2f5b96", "name": "network-vif-plugged", "status": "completed", "tag": "8c6c9aed-3c9f-4c5c-814b-b0fc0027ed3f"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:44:39.045005 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-42ebd546-5516-4770-9d2c-d8e658899386 req-a2d23056-ea23-4c75-b1ad-be09d44db9e2 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:39.045478 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-42ebd546-5516-4770-9d2c-d8e658899386 req-a2d23056-ea23-4c75-b1ad-be09d44db9e2 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:39.045915 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-42ebd546-5516-4770-9d2c-d8e658899386 req-a2d23056-ea23-4c75-b1ad-be09d44db9e2 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:39.057307 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-42ebd546-5516-4770-9d2c-d8e658899386 req-a2d23056-ea23-4c75-b1ad-be09d44db9e2 service nova] Creating event network-vif-plugged:8c6c9aed-3c9f-4c5c-814b-b0fc0027ed3f for instance 40b2189c-92c2-47aa-bcd5-579ede2f5b96 on hv-cinder-86283 Oct 27 17:44:39.062362 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-42ebd546-5516-4770-9d2c-d8e658899386 req-a2d23056-ea23-4c75-b1ad-be09d44db9e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033010 Oct 27 17:44:39.062948 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 609/1189] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:44:39.095439 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-118afd7b-bae7-4e69-a168-9a1591a6ea46 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:39.103585 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-118afd7b-bae7-4e69-a168-9a1591a6ea46 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1267 microversion: 2.1 time: 0.166605 Oct 27 17:44:39.104169 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 581/1190] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:38 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:44:40.038948 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:44:40.044220 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-aeb1810a-7861-4b37-af65-5529f730bb0f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:40.044927 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-aeb1810a-7861-4b37-af65-5529f730bb0f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:40.051314 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aeb1810a-7861-4b37-af65-5529f730bb0f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:40.051824 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aeb1810a-7861-4b37-af65-5529f730bb0f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:40.052257 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aeb1810a-7861-4b37-af65-5529f730bb0f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:40.052939 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aeb1810a-7861-4b37-af65-5529f730bb0f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:40.053391 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aeb1810a-7861-4b37-af65-5529f730bb0f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:40.053814 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aeb1810a-7861-4b37-af65-5529f730bb0f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:40.126340 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3af4f333-ea24-4146-8c9a-a2465ad594be tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:40.127230 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-3af4f333-ea24-4146-8c9a-a2465ad594be tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:40.133759 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3af4f333-ea24-4146-8c9a-a2465ad594be tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:40.134234 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3af4f333-ea24-4146-8c9a-a2465ad594be tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:40.134672 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3af4f333-ea24-4146-8c9a-a2465ad594be tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:40.135343 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3af4f333-ea24-4146-8c9a-a2465ad594be tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:40.135815 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3af4f333-ea24-4146-8c9a-a2465ad594be tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:40.136231 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3af4f333-ea24-4146-8c9a-a2465ad594be tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:40.182336 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-aeb1810a-7861-4b37-af65-5529f730bb0f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:40.189957 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-aeb1810a-7861-4b37-af65-5529f730bb0f tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 200 len: 1319 microversion: 2.1 time: 0.152050 Oct 27 17:44:40.190526 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 610/1191] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:40 2022] GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:40.265173 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-3af4f333-ea24-4146-8c9a-a2465ad594be tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:40.272878 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-3af4f333-ea24-4146-8c9a-a2465ad594be tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1267 microversion: 2.1 time: 0.150411 Oct 27 17:44:40.274111 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 582/1192] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:40 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:44:41.213516 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-729c839c-0fee-4033-97bc-09901d6883e4 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:41.214161 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-729c839c-0fee-4033-97bc-09901d6883e4 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:41.220778 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-729c839c-0fee-4033-97bc-09901d6883e4 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:41.221258 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-729c839c-0fee-4033-97bc-09901d6883e4 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:41.221690 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-729c839c-0fee-4033-97bc-09901d6883e4 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:41.222374 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-729c839c-0fee-4033-97bc-09901d6883e4 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:41.222824 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-729c839c-0fee-4033-97bc-09901d6883e4 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:41.223249 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-729c839c-0fee-4033-97bc-09901d6883e4 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:41.296352 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-c11866ad-5fb8-4755-b046-f945631aa1c7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:41.297065 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c11866ad-5fb8-4755-b046-f945631aa1c7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:41.303534 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c11866ad-5fb8-4755-b046-f945631aa1c7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:41.304052 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c11866ad-5fb8-4755-b046-f945631aa1c7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:41.304652 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c11866ad-5fb8-4755-b046-f945631aa1c7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:41.305819 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c11866ad-5fb8-4755-b046-f945631aa1c7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:41.306266 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c11866ad-5fb8-4755-b046-f945631aa1c7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:41.306681 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c11866ad-5fb8-4755-b046-f945631aa1c7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:41.355065 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-729c839c-0fee-4033-97bc-09901d6883e4 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:41.363100 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-729c839c-0fee-4033-97bc-09901d6883e4 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 200 len: 1319 microversion: 2.1 time: 0.153453 Oct 27 17:44:41.363667 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 611/1193] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:41 2022] GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:41.446244 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-c11866ad-5fb8-4755-b046-f945631aa1c7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:41.453906 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-c11866ad-5fb8-4755-b046-f945631aa1c7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1267 microversion: 2.1 time: 0.161498 Oct 27 17:44:41.454476 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 583/1194] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:41 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:44:42.386238 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-cce63cd8-b92d-4eaa-ad49-4d18c78ce83e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:42.386845 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-cce63cd8-b92d-4eaa-ad49-4d18c78ce83e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:42.393296 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cce63cd8-b92d-4eaa-ad49-4d18c78ce83e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:42.393765 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cce63cd8-b92d-4eaa-ad49-4d18c78ce83e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:42.394192 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cce63cd8-b92d-4eaa-ad49-4d18c78ce83e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:42.394869 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cce63cd8-b92d-4eaa-ad49-4d18c78ce83e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:42.395314 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cce63cd8-b92d-4eaa-ad49-4d18c78ce83e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:42.395747 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cce63cd8-b92d-4eaa-ad49-4d18c78ce83e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:42.477606 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-01229cc2-c051-4e51-97d8-31de597b6f27 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:42.478216 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-01229cc2-c051-4e51-97d8-31de597b6f27 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:42.484654 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-01229cc2-c051-4e51-97d8-31de597b6f27 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:42.485125 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-01229cc2-c051-4e51-97d8-31de597b6f27 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:42.485554 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-01229cc2-c051-4e51-97d8-31de597b6f27 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:42.486244 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-01229cc2-c051-4e51-97d8-31de597b6f27 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:42.486690 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-01229cc2-c051-4e51-97d8-31de597b6f27 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:42.487107 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-01229cc2-c051-4e51-97d8-31de597b6f27 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:42.528667 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-cce63cd8-b92d-4eaa-ad49-4d18c78ce83e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:42.536465 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-cce63cd8-b92d-4eaa-ad49-4d18c78ce83e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 200 len: 1509 microversion: 2.1 time: 0.154703 Oct 27 17:44:42.537040 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 612/1195] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:42 2022] GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:42.560121 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b40dc3e6-e2b1-40af-8049-e56ff14268ab tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bdab371-0074-45d2-8e3b-33c225b615c6", "device": "/dev/sdb"}} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:44:42.563005 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b40dc3e6-e2b1-40af-8049-e56ff14268ab tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:42.569323 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b40dc3e6-e2b1-40af-8049-e56ff14268ab tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:42.569804 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b40dc3e6-e2b1-40af-8049-e56ff14268ab tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:42.570299 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b40dc3e6-e2b1-40af-8049-e56ff14268ab tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:42.571007 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b40dc3e6-e2b1-40af-8049-e56ff14268ab tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:42.571463 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b40dc3e6-e2b1-40af-8049-e56ff14268ab tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:42.571925 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b40dc3e6-e2b1-40af-8049-e56ff14268ab tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:42.618156 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-01229cc2-c051-4e51-97d8-31de597b6f27 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:42.625752 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-01229cc2-c051-4e51-97d8-31de597b6f27 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1267 microversion: 2.1 time: 0.152778 Oct 27 17:44:42.626322 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 584/1196] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:42 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:44:42.822644 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b40dc3e6-e2b1-40af-8049-e56ff14268ab tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "POST /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266068 Oct 27 17:44:42.823272 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 613/1197] 10.222.0.36 () {60 vars in 1323 bytes} [Thu Oct 27 17:44:42 2022] POST /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:44:43.648328 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-98545ca6-7088-4edd-a387-05a16a33e834 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:43.648931 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-98545ca6-7088-4edd-a387-05a16a33e834 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:43.655870 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-98545ca6-7088-4edd-a387-05a16a33e834 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:43.656264 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-98545ca6-7088-4edd-a387-05a16a33e834 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:43.656686 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-98545ca6-7088-4edd-a387-05a16a33e834 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:43.657359 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-98545ca6-7088-4edd-a387-05a16a33e834 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:43.657804 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-98545ca6-7088-4edd-a387-05a16a33e834 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:43.658219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-98545ca6-7088-4edd-a387-05a16a33e834 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:43.786319 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-98545ca6-7088-4edd-a387-05a16a33e834 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:43.794016 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-98545ca6-7088-4edd-a387-05a16a33e834 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1267 microversion: 2.1 time: 0.149800 Oct 27 17:44:43.794583 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 585/1198] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:43 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:44.816926 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-01f63d1a-3cfb-4714-b258-77b873a46d13 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:44.817618 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-01f63d1a-3cfb-4714-b258-77b873a46d13 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:44.824738 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01f63d1a-3cfb-4714-b258-77b873a46d13 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:44.825212 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01f63d1a-3cfb-4714-b258-77b873a46d13 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:44.825639 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01f63d1a-3cfb-4714-b258-77b873a46d13 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:44.826316 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01f63d1a-3cfb-4714-b258-77b873a46d13 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:44.826760 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01f63d1a-3cfb-4714-b258-77b873a46d13 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:44.827175 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-01f63d1a-3cfb-4714-b258-77b873a46d13 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:44.960220 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-01f63d1a-3cfb-4714-b258-77b873a46d13 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:44.968985 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-01f63d1a-3cfb-4714-b258-77b873a46d13 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1267 microversion: 2.1 time: 0.156294 Oct 27 17:44:44.969544 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 614/1199] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:44 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:45.991985 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ec144c8e-bfe2-42c2-baa3-f224517e3499 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:45.992597 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ec144c8e-bfe2-42c2-baa3-f224517e3499 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:45.994985 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=2 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:44:45.995635 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=8 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:44:46.001783 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ec144c8e-bfe2-42c2-baa3-f224517e3499 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:46.002259 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ec144c8e-bfe2-42c2-baa3-f224517e3499 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:46.002691 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ec144c8e-bfe2-42c2-baa3-f224517e3499 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:46.003381 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ec144c8e-bfe2-42c2-baa3-f224517e3499 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:46.004149 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ec144c8e-bfe2-42c2-baa3-f224517e3499 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:46.004273 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ec144c8e-bfe2-42c2-baa3-f224517e3499 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:46.135735 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ec144c8e-bfe2-42c2-baa3-f224517e3499 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:46.143249 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ec144c8e-bfe2-42c2-baa3-f224517e3499 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1267 microversion: 2.1 time: 0.155245 Oct 27 17:44:46.143825 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 586/1200] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:45 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:47.166704 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d7d97013-167a-4d2c-9b04-39ae5de714e4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:47.167315 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d7d97013-167a-4d2c-9b04-39ae5de714e4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:47.169801 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=8 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:44:47.175367 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d7d97013-167a-4d2c-9b04-39ae5de714e4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:47.175880 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d7d97013-167a-4d2c-9b04-39ae5de714e4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:47.176317 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d7d97013-167a-4d2c-9b04-39ae5de714e4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:47.177004 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d7d97013-167a-4d2c-9b04-39ae5de714e4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:47.177452 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d7d97013-167a-4d2c-9b04-39ae5de714e4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:47.177878 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d7d97013-167a-4d2c-9b04-39ae5de714e4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:47.305387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d7d97013-167a-4d2c-9b04-39ae5de714e4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:47.313093 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d7d97013-167a-4d2c-9b04-39ae5de714e4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1267 microversion: 2.1 time: 0.150713 Oct 27 17:44:47.313658 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 615/1201] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:47 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:48.334275 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d4fd0561-2b49-4669-b9f1-f47ad6d4ada1 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:48.334884 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d4fd0561-2b49-4669-b9f1-f47ad6d4ada1 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:48.341380 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d4fd0561-2b49-4669-b9f1-f47ad6d4ada1 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:48.341860 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d4fd0561-2b49-4669-b9f1-f47ad6d4ada1 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:48.342289 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d4fd0561-2b49-4669-b9f1-f47ad6d4ada1 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:48.342972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d4fd0561-2b49-4669-b9f1-f47ad6d4ada1 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:48.343419 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d4fd0561-2b49-4669-b9f1-f47ad6d4ada1 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:48.343867 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d4fd0561-2b49-4669-b9f1-f47ad6d4ada1 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:48.471788 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d4fd0561-2b49-4669-b9f1-f47ad6d4ada1 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:48.480223 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d4fd0561-2b49-4669-b9f1-f47ad6d4ada1 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1267 microversion: 2.1 time: 0.149805 Oct 27 17:44:48.480797 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 587/1202] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:48 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:49.004313 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-331fc5a4-3991-4bf0-be7b-f46f63aa1a58 req-fb87a373-afb8-4ca4-8cd7-b6e8fbb9b69a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd62978f-8c7f-4d02-8742-98a3a867dd4e", "name": "network-vif-plugged", "status": "completed", "tag": "7c5fa515-d946-464e-a169-1cd450b97264"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:44:49.014401 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-331fc5a4-3991-4bf0-be7b-f46f63aa1a58 req-fb87a373-afb8-4ca4-8cd7-b6e8fbb9b69a service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:49.014888 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-331fc5a4-3991-4bf0-be7b-f46f63aa1a58 req-fb87a373-afb8-4ca4-8cd7-b6e8fbb9b69a service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:49.015327 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-331fc5a4-3991-4bf0-be7b-f46f63aa1a58 req-fb87a373-afb8-4ca4-8cd7-b6e8fbb9b69a service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:49.027235 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-331fc5a4-3991-4bf0-be7b-f46f63aa1a58 req-fb87a373-afb8-4ca4-8cd7-b6e8fbb9b69a service nova] Creating event network-vif-plugged:7c5fa515-d946-464e-a169-1cd450b97264 for instance cd62978f-8c7f-4d02-8742-98a3a867dd4e on hv-cinder-86283 Oct 27 17:44:49.032633 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-331fc5a4-3991-4bf0-be7b-f46f63aa1a58 req-fb87a373-afb8-4ca4-8cd7-b6e8fbb9b69a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032021 Oct 27 17:44:49.033772 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 616/1203] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:44:49.503405 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d6f7c2af-278e-40fb-bc8e-bcc0a33e0e7d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:49.504024 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d6f7c2af-278e-40fb-bc8e-bcc0a33e0e7d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:49.511868 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d6f7c2af-278e-40fb-bc8e-bcc0a33e0e7d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:49.512473 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d6f7c2af-278e-40fb-bc8e-bcc0a33e0e7d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:49.513184 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d6f7c2af-278e-40fb-bc8e-bcc0a33e0e7d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:49.513951 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d6f7c2af-278e-40fb-bc8e-bcc0a33e0e7d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:49.514479 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d6f7c2af-278e-40fb-bc8e-bcc0a33e0e7d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:49.514968 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d6f7c2af-278e-40fb-bc8e-bcc0a33e0e7d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:49.701635 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d6f7c2af-278e-40fb-bc8e-bcc0a33e0e7d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:49.709392 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d6f7c2af-278e-40fb-bc8e-bcc0a33e0e7d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1267 microversion: 2.1 time: 0.210147 Oct 27 17:44:49.709957 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 588/1204] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:49 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:50.732833 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-1557095e-2d67-42c8-964f-3469c6b7aaf5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:50.733529 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-1557095e-2d67-42c8-964f-3469c6b7aaf5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:50.739731 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1557095e-2d67-42c8-964f-3469c6b7aaf5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:50.740232 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1557095e-2d67-42c8-964f-3469c6b7aaf5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:50.740666 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1557095e-2d67-42c8-964f-3469c6b7aaf5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:50.741351 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1557095e-2d67-42c8-964f-3469c6b7aaf5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:50.741805 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1557095e-2d67-42c8-964f-3469c6b7aaf5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:50.742227 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-1557095e-2d67-42c8-964f-3469c6b7aaf5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:50.870083 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-1557095e-2d67-42c8-964f-3469c6b7aaf5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:50.877749 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-1557095e-2d67-42c8-964f-3469c6b7aaf5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1267 microversion: 2.1 time: 0.149781 Oct 27 17:44:50.878309 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 617/1205] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:50 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:51.901209 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-cbfc3f55-11a5-49f9-adf6-cd48c030c4df tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:51.901817 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-cbfc3f55-11a5-49f9-adf6-cd48c030c4df tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:51.908194 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cbfc3f55-11a5-49f9-adf6-cd48c030c4df tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:51.908666 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cbfc3f55-11a5-49f9-adf6-cd48c030c4df tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:51.909094 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cbfc3f55-11a5-49f9-adf6-cd48c030c4df tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:51.909768 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cbfc3f55-11a5-49f9-adf6-cd48c030c4df tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:51.910218 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cbfc3f55-11a5-49f9-adf6-cd48c030c4df tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:51.910635 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-cbfc3f55-11a5-49f9-adf6-cd48c030c4df tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:52.044892 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-cbfc3f55-11a5-49f9-adf6-cd48c030c4df tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:52.052411 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-cbfc3f55-11a5-49f9-adf6-cd48c030c4df tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1267 microversion: 2.1 time: 0.155640 Oct 27 17:44:52.052975 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 589/1206] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:51 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:53.074475 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-088231c6-ecb9-4d40-a2ea-f63da26de9bf tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:53.075218 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-088231c6-ecb9-4d40-a2ea-f63da26de9bf tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:53.081651 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-088231c6-ecb9-4d40-a2ea-f63da26de9bf tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:53.082107 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-088231c6-ecb9-4d40-a2ea-f63da26de9bf tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:53.082534 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-088231c6-ecb9-4d40-a2ea-f63da26de9bf tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:53.083212 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-088231c6-ecb9-4d40-a2ea-f63da26de9bf tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:53.083659 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-088231c6-ecb9-4d40-a2ea-f63da26de9bf tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:53.084100 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-088231c6-ecb9-4d40-a2ea-f63da26de9bf tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:53.214662 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-088231c6-ecb9-4d40-a2ea-f63da26de9bf tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:53.218148 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:44:53.223035 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-088231c6-ecb9-4d40-a2ea-f63da26de9bf tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1267 microversion: 2.1 time: 0.152508 Oct 27 17:44:53.223596 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 618/1207] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:53 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:54.245763 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-49df6ac1-f240-4000-91a7-cefe64496f37 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:54.246365 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-49df6ac1-f240-4000-91a7-cefe64496f37 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:54.252853 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-49df6ac1-f240-4000-91a7-cefe64496f37 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:54.253325 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-49df6ac1-f240-4000-91a7-cefe64496f37 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:54.253748 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-49df6ac1-f240-4000-91a7-cefe64496f37 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:54.254436 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-49df6ac1-f240-4000-91a7-cefe64496f37 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:54.254878 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-49df6ac1-f240-4000-91a7-cefe64496f37 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:54.255296 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-49df6ac1-f240-4000-91a7-cefe64496f37 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:54.382195 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-49df6ac1-f240-4000-91a7-cefe64496f37 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:54.390375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-49df6ac1-f240-4000-91a7-cefe64496f37 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1267 microversion: 2.1 time: 0.148910 Oct 27 17:44:54.391023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 590/1208] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:54 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:55.413592 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-05fb9ae5-cd9b-4b5b-aca0-422313cbe002 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:55.414201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-05fb9ae5-cd9b-4b5b-aca0-422313cbe002 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:55.421243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-05fb9ae5-cd9b-4b5b-aca0-422313cbe002 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:55.421725 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-05fb9ae5-cd9b-4b5b-aca0-422313cbe002 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:55.422158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-05fb9ae5-cd9b-4b5b-aca0-422313cbe002 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:55.422851 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-05fb9ae5-cd9b-4b5b-aca0-422313cbe002 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:55.423304 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-05fb9ae5-cd9b-4b5b-aca0-422313cbe002 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:55.423738 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-05fb9ae5-cd9b-4b5b-aca0-422313cbe002 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:55.550893 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-05fb9ae5-cd9b-4b5b-aca0-422313cbe002 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:55.559316 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-05fb9ae5-cd9b-4b5b-aca0-422313cbe002 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1455 microversion: 2.1 time: 0.150308 Oct 27 17:44:55.559908 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 619/1209] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:55 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:55.581403 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-1f4d5fe9-3611-4156-baf8-693e3bee371d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:44:55.582145 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-1f4d5fe9-3611-4156-baf8-693e3bee371d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:44:55.588676 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f4d5fe9-3611-4156-baf8-693e3bee371d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:55.589152 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f4d5fe9-3611-4156-baf8-693e3bee371d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:55.589581 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f4d5fe9-3611-4156-baf8-693e3bee371d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:55.590264 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f4d5fe9-3611-4156-baf8-693e3bee371d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:55.590710 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f4d5fe9-3611-4156-baf8-693e3bee371d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:55.591213 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1f4d5fe9-3611-4156-baf8-693e3bee371d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:55.721543 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1f4d5fe9-3611-4156-baf8-693e3bee371d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:44:55.729506 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-1f4d5fe9-3611-4156-baf8-693e3bee371d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1455 microversion: 2.1 time: 0.151918 Oct 27 17:44:55.730075 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 591/1210] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:44:55 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:44:57.639201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-ab9b0e9d-00a1-40f8-af25-4e8c6b631530 req-476f0bc2-dcfe-4b98-8f92-c67835f91d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd62978f-8c7f-4d02-8742-98a3a867dd4e", "tag": "7c5fa515-d946-464e-a169-1cd450b97264"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:44:57.649405 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-ab9b0e9d-00a1-40f8-af25-4e8c6b631530 req-476f0bc2-dcfe-4b98-8f92-c67835f91d4a service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:44:57.649884 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-ab9b0e9d-00a1-40f8-af25-4e8c6b631530 req-476f0bc2-dcfe-4b98-8f92-c67835f91d4a service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:44:57.650320 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-ab9b0e9d-00a1-40f8-af25-4e8c6b631530 req-476f0bc2-dcfe-4b98-8f92-c67835f91d4a service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:44:57.661748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-ab9b0e9d-00a1-40f8-af25-4e8c6b631530 req-476f0bc2-dcfe-4b98-8f92-c67835f91d4a service nova] Creating event network-changed:7c5fa515-d946-464e-a169-1cd450b97264 for instance cd62978f-8c7f-4d02-8742-98a3a867dd4e on hv-cinder-86283 Oct 27 17:44:57.667260 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-ab9b0e9d-00a1-40f8-af25-4e8c6b631530 req-476f0bc2-dcfe-4b98-8f92-c67835f91d4a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031722 Oct 27 17:44:57.668467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 620/1211] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:45:05.251026 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-989fc775-105a-4df8-94b0-8ce4ca210d94 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:45:05.251558 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-989fc775-105a-4df8-94b0-8ce4ca210d94 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:45:05.254068 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:45:05.259220 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-989fc775-105a-4df8-94b0-8ce4ca210d94 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:45:05.259700 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-989fc775-105a-4df8-94b0-8ce4ca210d94 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:45:05.260154 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-989fc775-105a-4df8-94b0-8ce4ca210d94 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:45:05.260868 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-989fc775-105a-4df8-94b0-8ce4ca210d94 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:45:05.261346 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-989fc775-105a-4df8-94b0-8ce4ca210d94 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:45:05.261768 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-989fc775-105a-4df8-94b0-8ce4ca210d94 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:45:05.265087 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=95 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:45:05.342213 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-989fc775-105a-4df8-94b0-8ce4ca210d94 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lazy-loading 'services' on Instance uuid 40b2189c-92c2-47aa-bcd5-579ede2f5b96 {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:45:05.411985 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-989fc775-105a-4df8-94b0-8ce4ca210d94 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "DELETE /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96/os-volume_attachments/9bdab371-0074-45d2-8e3b-33c225b615c6" status: 202 len: 0 microversion: 2.1 time: 0.164722 Oct 27 17:45:05.412557 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 592/1212] 10.222.0.36 () {58 vars in 1416 bytes} [Thu Oct 27 17:45:05 2022] DELETE /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96/os-volume_attachments/9bdab371-0074-45d2-8e3b-33c225b615c6 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 17:45:06.536168 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4fbba562-bb05-4de9-a2bf-a2059c135dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:45:06.536755 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4fbba562-bb05-4de9-a2bf-a2059c135dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:45:06.538710 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:45:06.544242 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fbba562-bb05-4de9-a2bf-a2059c135dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:45:06.544720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fbba562-bb05-4de9-a2bf-a2059c135dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:45:06.545156 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fbba562-bb05-4de9-a2bf-a2059c135dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:45:06.545852 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fbba562-bb05-4de9-a2bf-a2059c135dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:45:06.546299 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fbba562-bb05-4de9-a2bf-a2059c135dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:45:06.546723 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fbba562-bb05-4de9-a2bf-a2059c135dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:45:06.574856 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4fbba562-bb05-4de9-a2bf-a2059c135dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Going to try to terminate instance {{(pid=119047) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:45:06.650767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4fbba562-bb05-4de9-a2bf-a2059c135dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "DELETE /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 204 len: 0 microversion: 2.1 time: 0.118819 Oct 27 17:45:06.651460 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 621/1213] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:45:06 2022] DELETE /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:45:06.661066 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-4357ab8e-77a6-419c-9033-865e9e590854 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:45:06.661847 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-4357ab8e-77a6-419c-9033-865e9e590854 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:45:06.668125 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4357ab8e-77a6-419c-9033-865e9e590854 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:45:06.668596 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4357ab8e-77a6-419c-9033-865e9e590854 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:45:06.669024 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4357ab8e-77a6-419c-9033-865e9e590854 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:45:06.669699 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4357ab8e-77a6-419c-9033-865e9e590854 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:45:06.670143 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4357ab8e-77a6-419c-9033-865e9e590854 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:45:06.670555 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-4357ab8e-77a6-419c-9033-865e9e590854 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:45:06.800730 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-4357ab8e-77a6-419c-9033-865e9e590854 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:45:06.808314 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-4357ab8e-77a6-419c-9033-865e9e590854 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 200 len: 1515 microversion: 2.1 time: 0.151984 Oct 27 17:45:06.808880 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 593/1214] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:45:06 2022] GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:45:07.831431 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-178d23ce-3a02-49bf-aeba-f53d1dd13dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:45:07.832106 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-178d23ce-3a02-49bf-aeba-f53d1dd13dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:45:07.839026 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-178d23ce-3a02-49bf-aeba-f53d1dd13dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:45:07.839501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-178d23ce-3a02-49bf-aeba-f53d1dd13dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:45:07.839971 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-178d23ce-3a02-49bf-aeba-f53d1dd13dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:45:07.840655 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-178d23ce-3a02-49bf-aeba-f53d1dd13dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:45:07.841102 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-178d23ce-3a02-49bf-aeba-f53d1dd13dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:45:07.841520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-178d23ce-3a02-49bf-aeba-f53d1dd13dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:45:07.972587 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-178d23ce-3a02-49bf-aeba-f53d1dd13dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:45:07.980488 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-178d23ce-3a02-49bf-aeba-f53d1dd13dd1 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 200 len: 1515 microversion: 2.1 time: 0.153459 Oct 27 17:45:07.981052 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 622/1215] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:45:07 2022] GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:45:09.002690 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-52d1d75e-5581-4972-8fe1-3e6474d11ce7 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:45:09.003302 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-52d1d75e-5581-4972-8fe1-3e6474d11ce7 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:45:09.009209 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-52d1d75e-5581-4972-8fe1-3e6474d11ce7 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:45:09.009688 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-52d1d75e-5581-4972-8fe1-3e6474d11ce7 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:45:09.010120 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-52d1d75e-5581-4972-8fe1-3e6474d11ce7 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:45:09.010806 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-52d1d75e-5581-4972-8fe1-3e6474d11ce7 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:45:09.011256 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-52d1d75e-5581-4972-8fe1-3e6474d11ce7 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:45:09.011680 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-52d1d75e-5581-4972-8fe1-3e6474d11ce7 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:45:09.088352 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-52d1d75e-5581-4972-8fe1-3e6474d11ce7 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6295a8005ea40ffb4d48cf86bb3c626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737d405702b943f1aaab986473bc833d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:45:09.096677 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-52d1d75e-5581-4972-8fe1-3e6474d11ce7 tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 200 len: 1473 microversion: 2.1 time: 0.098128 Oct 27 17:45:09.097255 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 594/1216] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:45:08 2022] GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 1473 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:45:09.136062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-ca90d9c4-e619-41f9-a5b3-c589b326556a req-ad05a823-f8c9-45ef-861b-8f64d1a16f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40b2189c-92c2-47aa-bcd5-579ede2f5b96", "name": "network-vif-deleted", "tag": "8c6c9aed-3c9f-4c5c-814b-b0fc0027ed3f"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:45:09.147140 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-ca90d9c4-e619-41f9-a5b3-c589b326556a req-ad05a823-f8c9-45ef-861b-8f64d1a16f09 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:45:09.147678 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-ca90d9c4-e619-41f9-a5b3-c589b326556a req-ad05a823-f8c9-45ef-861b-8f64d1a16f09 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:45:09.148195 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-ca90d9c4-e619-41f9-a5b3-c589b326556a req-ad05a823-f8c9-45ef-861b-8f64d1a16f09 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:45:09.160593 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-ca90d9c4-e619-41f9-a5b3-c589b326556a req-ad05a823-f8c9-45ef-861b-8f64d1a16f09 service nova] Creating event network-vif-deleted:8c6c9aed-3c9f-4c5c-814b-b0fc0027ed3f for instance 40b2189c-92c2-47aa-bcd5-579ede2f5b96 on hv-cinder-86283 Oct 27 17:45:09.165993 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-ca90d9c4-e619-41f9-a5b3-c589b326556a req-ad05a823-f8c9-45ef-861b-8f64d1a16f09 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033962 Oct 27 17:45:09.167771 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 623/1217] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:45:10.120592 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-770f3ff6-8286-471a-a54b-51133eb0477e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:45:10.121211 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-770f3ff6-8286-471a-a54b-51133eb0477e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] [instance: 40b2189c-92c2-47aa-bcd5-579ede2f5b96] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:45:10.127668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-770f3ff6-8286-471a-a54b-51133eb0477e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:45:10.128173 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-770f3ff6-8286-471a-a54b-51133eb0477e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:45:10.128604 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-770f3ff6-8286-471a-a54b-51133eb0477e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:45:10.129288 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-770f3ff6-8286-471a-a54b-51133eb0477e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:45:10.129738 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-770f3ff6-8286-471a-a54b-51133eb0477e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:45:10.130160 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-770f3ff6-8286-471a-a54b-51133eb0477e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:45:10.143487 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-770f3ff6-8286-471a-a54b-51133eb0477e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] HTTP exception thrown: Instance 40b2189c-92c2-47aa-bcd5-579ede2f5b96 could not be found. Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-770f3ff6-8286-471a-a54b-51133eb0477e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Request method failure captured: Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 HTTP/1.1 Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsMbRFJr--T7cIJ6r9Z_IBNtqVW1ndcDIBsh80lNjgrSxZE7k_A8PJlCpnt7oJw3uA3sa1I3NPDQXqxh2ZX-KWCQguqbdLWY0KRqhtpSFzhwTnQBD_oGk9c-y8Akfjq-f12JSu-9TgmovG2vLNJ8gjPhJxGUkhNk_zvawQKFAM4iRPY Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: 737d405702b943f1aaab986473bc833d Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1032049549 Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:45:10.145141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:45:10.146929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/737d405702b943f1aaab986473bc833d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/737d405702b943f1aaab986473bc833d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_737d405702b943f1aaab986473bc833d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/737d405702b943f1aaab986473bc833d"}]}] Oct 27 17:45:10.146929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-VolumesSnapshotTestJSON-1032049549 Oct 27 17:45:10.146929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: 737d405702b943f1aaab986473bc833d Oct 27 17:45:10.146929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1032049549 Oct 27 17:45:10.146929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-VolumesSnapshotTestJSON-1032049549-project Oct 27 17:45:10.146929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:45:10.146929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:45:10.146929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: a6295a8005ea40ffb4d48cf86bb3c626 Oct 27 17:45:10.146929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-VolumesSnapshotTestJSON-1032049549-project Oct 27 17:45:10.146929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:45:10.146929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance 40b2189c-92c2-47aa-bcd5-579ede2f5b96 could not be found. Oct 27 17:45:10.146929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': '40b2189c-92c2-47aa-bcd5-579ede2f5b96'} Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40b2189c-92c2-47aa-bcd5-579ede2f5b96 could not be found. Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:45:10.148098 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40b2189c-92c2-47aa-bcd5-579ede2f5b96 could not be found. Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40b2189c-92c2-47aa-bcd5-579ede2f5b96 could not be found. Oct 27 17:45:10.149773 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:45:10.151453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-770f3ff6-8286-471a-a54b-51133eb0477e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] Returning 404 to user: Instance 40b2189c-92c2-47aa-bcd5-579ede2f5b96 could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:45:10.151453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-770f3ff6-8286-471a-a54b-51133eb0477e tempest-VolumesSnapshotTestJSON-1032049549 tempest-VolumesSnapshotTestJSON-1032049549-project] 10.222.0.36 "GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96" status: 404 len: 111 microversion: 2.1 time: 0.030478 Oct 27 17:45:10.151453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 595/1218] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:45:10 2022] GET /compute/v2.1/servers/40b2189c-92c2-47aa-bcd5-579ede2f5b96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:47:14.994140 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3117ccbe-c345-4204-afa1-6224d10893f7] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 17:47:14.994968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:47:14.995704 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:47:14.996801 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 17:47:14.997111 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Thu Oct 27 17:47:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e (ip 10.222.0.36) !!! Oct 27 17:47:14.998604 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 17:47:14.998723 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Thu Oct 27 17:47:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e (ip 10.222.0.36) !!! Oct 27 17:47:15.005574 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a99f18f8-ea20-4e72-9df5-74301eade961 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:15.006151 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a99f18f8-ea20-4e72-9df5-74301eade961 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:15.017525 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a99f18f8-ea20-4e72-9df5-74301eade961 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:15.017998 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a99f18f8-ea20-4e72-9df5-74301eade961 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:15.018425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a99f18f8-ea20-4e72-9df5-74301eade961 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:15.019116 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a99f18f8-ea20-4e72-9df5-74301eade961 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:15.019563 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a99f18f8-ea20-4e72-9df5-74301eade961 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:15.020017 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a99f18f8-ea20-4e72-9df5-74301eade961 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:15.045891 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a99f18f8-ea20-4e72-9df5-74301eade961 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Going to try to terminate instance {{(pid=119047) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:47:15.120714 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a99f18f8-ea20-4e72-9df5-74301eade961 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 204 len: 0 microversion: 2.1 time: 0.128985 Oct 27 17:47:15.121302 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 624/1219] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:47:14 2022] DELETE /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:47:15.130777 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-3d2d35c9-f474-4226-a692-869a2713981e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:15.131393 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-3d2d35c9-f474-4226-a692-869a2713981e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:15.134380 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e34ce073-cb66-461c-9aa4-4731a59fd62d] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 17:47:15.134928 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=7 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:47:15.135550 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:47:15.136927 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 17:47:15.137118 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Thu Oct 27 17:47:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e (ip 10.222.0.36) !!! Oct 27 17:47:15.138581 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 27 17:47:15.138727 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Thu Oct 27 17:47:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e (ip 10.222.0.36) !!! Oct 27 17:47:15.149668 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3d2d35c9-f474-4226-a692-869a2713981e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:15.150178 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3d2d35c9-f474-4226-a692-869a2713981e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:15.150614 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3d2d35c9-f474-4226-a692-869a2713981e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:15.151310 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3d2d35c9-f474-4226-a692-869a2713981e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:15.151789 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3d2d35c9-f474-4226-a692-869a2713981e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:15.152209 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-3d2d35c9-f474-4226-a692-869a2713981e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:15.484469 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-3d2d35c9-f474-4226-a692-869a2713981e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:15.492042 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-3d2d35c9-f474-4226-a692-869a2713981e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1579 microversion: 2.1 time: 0.365834 Oct 27 17:47:15.492605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 596/1220] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:15 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1579 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:16.514846 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-feef470a-422e-4cac-9c6c-5b5055b58e74 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:16.515576 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-feef470a-422e-4cac-9c6c-5b5055b58e74 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:16.524750 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-feef470a-422e-4cac-9c6c-5b5055b58e74 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:16.525506 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-feef470a-422e-4cac-9c6c-5b5055b58e74 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:16.526229 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-feef470a-422e-4cac-9c6c-5b5055b58e74 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:16.527101 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-feef470a-422e-4cac-9c6c-5b5055b58e74 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:16.527571 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-feef470a-422e-4cac-9c6c-5b5055b58e74 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:16.528314 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-feef470a-422e-4cac-9c6c-5b5055b58e74 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:16.536219 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO oslo.messaging._drivers.impl_rabbit [-] [3117ccbe-c345-4204-afa1-6224d10893f7] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 55050. Oct 27 17:47:16.714844 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-feef470a-422e-4cac-9c6c-5b5055b58e74 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:16.722637 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-feef470a-422e-4cac-9c6c-5b5055b58e74 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1579 microversion: 2.1 time: 0.212082 Oct 27 17:47:16.723216 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 625/1221] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:16 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1579 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:17.747133 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-633d9e21-10fc-46b1-b875-e3aed621cfde tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:17.747806 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-633d9e21-10fc-46b1-b875-e3aed621cfde tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:17.757766 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-633d9e21-10fc-46b1-b875-e3aed621cfde tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:17.758205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-633d9e21-10fc-46b1-b875-e3aed621cfde tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:17.759303 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-633d9e21-10fc-46b1-b875-e3aed621cfde tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:17.760029 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-633d9e21-10fc-46b1-b875-e3aed621cfde tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:17.760549 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-633d9e21-10fc-46b1-b875-e3aed621cfde tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:17.760976 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-633d9e21-10fc-46b1-b875-e3aed621cfde tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:17.767339 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO oslo.messaging._drivers.impl_rabbit [-] [e34ce073-cb66-461c-9aa4-4731a59fd62d] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 55060. Oct 27 17:47:17.831457 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-633d9e21-10fc-46b1-b875-e3aed621cfde tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:17.839161 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-633d9e21-10fc-46b1-b875-e3aed621cfde tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1511 microversion: 2.1 time: 0.096520 Oct 27 17:47:17.839751 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 597/1222] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:17 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1511 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:18.120560 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-d6b450cc-4d7d-41f2-914b-b91b2551b6b4 req-a10a4e43-9646-4ba9-92fc-c5e58935031b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd62978f-8c7f-4d02-8742-98a3a867dd4e", "name": "network-vif-deleted", "tag": "7c5fa515-d946-464e-a169-1cd450b97264"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:47:18.141244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-d6b450cc-4d7d-41f2-914b-b91b2551b6b4 req-a10a4e43-9646-4ba9-92fc-c5e58935031b service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:18.141753 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-d6b450cc-4d7d-41f2-914b-b91b2551b6b4 req-a10a4e43-9646-4ba9-92fc-c5e58935031b service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:18.142179 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-d6b450cc-4d7d-41f2-914b-b91b2551b6b4 req-a10a4e43-9646-4ba9-92fc-c5e58935031b service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:18.155978 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-d6b450cc-4d7d-41f2-914b-b91b2551b6b4 req-a10a4e43-9646-4ba9-92fc-c5e58935031b service nova] Creating event network-vif-deleted:7c5fa515-d946-464e-a169-1cd450b97264 for instance cd62978f-8c7f-4d02-8742-98a3a867dd4e on hv-cinder-86283 Oct 27 17:47:18.161148 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-d6b450cc-4d7d-41f2-914b-b91b2551b6b4 req-a10a4e43-9646-4ba9-92fc-c5e58935031b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114459 Oct 27 17:47:18.164060 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 626/1223] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:47:18.862271 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e5c3a7cf-2055-4057-b8f3-2343181ffa05 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:18.863200 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e5c3a7cf-2055-4057-b8f3-2343181ffa05 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:18.870381 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e5c3a7cf-2055-4057-b8f3-2343181ffa05 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:18.870954 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e5c3a7cf-2055-4057-b8f3-2343181ffa05 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:18.871394 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e5c3a7cf-2055-4057-b8f3-2343181ffa05 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:18.872146 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e5c3a7cf-2055-4057-b8f3-2343181ffa05 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:18.872621 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e5c3a7cf-2055-4057-b8f3-2343181ffa05 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:18.873042 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e5c3a7cf-2055-4057-b8f3-2343181ffa05 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:18.907514 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e5c3a7cf-2055-4057-b8f3-2343181ffa05 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:18.908027 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e5c3a7cf-2055-4057-b8f3-2343181ffa05 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:18.908460 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e5c3a7cf-2055-4057-b8f3-2343181ffa05 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:18.908897 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.objects.instance [None req-e5c3a7cf-2055-4057-b8f3-2343181ffa05 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lazy-loading 'fault' on Instance uuid cd62978f-8c7f-4d02-8742-98a3a867dd4e {{(pid=119046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 17:47:18.949756 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e5c3a7cf-2055-4057-b8f3-2343181ffa05 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:18.958071 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e5c3a7cf-2055-4057-b8f3-2343181ffa05 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 200 len: 1231 microversion: 2.1 time: 0.099632 Oct 27 17:47:18.959409 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 598/1224] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:18 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:19.983066 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-15cadce2-e293-4f88-8fc4-0f8c41864e8f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:19.983728 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-15cadce2-e293-4f88-8fc4-0f8c41864e8f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:19.990354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15cadce2-e293-4f88-8fc4-0f8c41864e8f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:19.990828 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15cadce2-e293-4f88-8fc4-0f8c41864e8f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:19.991258 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15cadce2-e293-4f88-8fc4-0f8c41864e8f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:19.991968 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15cadce2-e293-4f88-8fc4-0f8c41864e8f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:19.992418 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15cadce2-e293-4f88-8fc4-0f8c41864e8f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:19.993350 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-15cadce2-e293-4f88-8fc4-0f8c41864e8f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:20.006639 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-15cadce2-e293-4f88-8fc4-0f8c41864e8f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] HTTP exception thrown: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-15cadce2-e293-4f88-8fc4-0f8c41864e8f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Request method failure captured: Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e HTTP/1.1 Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsNbCv2S6QezRIc42LiTTWHJMkHp3PL1swC9021AC6L0LaFVsvYLj3GztS3MQcZvqjsouw2zSS0tdfKGP5rAHKrKJXPPcZUhp2UU_wYNhBk90CoMKVNrx81OAHSEEEJrcqiqiIpVKxlaHHrEKxj4DTjAfYCfW_XboZYyexLlyeZVHzA Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: e62c12b7398343648a02ef5c64cda2b1 Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-TestVolumeBootPattern-1346887961 Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:47:20.008285 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:47:20.010720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e62c12b7398343648a02ef5c64cda2b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e62c12b7398343648a02ef5c64cda2b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e62c12b7398343648a02ef5c64cda2b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e62c12b7398343648a02ef5c64cda2b1"}]}] Oct 27 17:47:20.010720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-TestVolumeBootPattern-1346887961 Oct 27 17:47:20.010720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: e62c12b7398343648a02ef5c64cda2b1 Oct 27 17:47:20.010720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-TestVolumeBootPattern-1346887961 Oct 27 17:47:20.010720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-TestVolumeBootPattern-1346887961-project Oct 27 17:47:20.010720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:47:20.010720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:47:20.010720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 7aa8ef56dea147fe9594ac6ae812aebb Oct 27 17:47:20.010720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-TestVolumeBootPattern-1346887961-project Oct 27 17:47:20.010720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:47:20.010720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. Oct 27 17:47:20.010720 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': 'cd62978f-8c7f-4d02-8742-98a3a867dd4e'} Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:47:20.011863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. Oct 27 17:47:20.013536 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:47:20.015062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-15cadce2-e293-4f88-8fc4-0f8c41864e8f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Returning 404 to user: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:47:20.015062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-15cadce2-e293-4f88-8fc4-0f8c41864e8f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 404 len: 111 microversion: 2.1 time: 0.031912 Oct 27 17:47:20.015062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 627/1225] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:19 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:47:20.106155 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1158927995", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1501870066", "security_groups": [{"name": "tempest-secgroup-smoke-1378820443"}], "block_device_mapping_v2": [{"uuid": "3c400c3e-40a6-4b7c-a956-2f6c7298b9a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cacaec05-05b8-4422-92f4-e7ab38239f98"}]}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:47:20.223513 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.network.neutron [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] validate_networks() for [('cacaec05-05b8-4422-92f4-e7ab38239f98', None, None, None, None, None)] {{(pid=119046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:47:20.588205 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Flavor limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:47:20.588622 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Image limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:47:20.589088 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Flavor pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:47:20.589490 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Image pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:47:20.589896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:47:20.598619 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:20.599089 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:20.599516 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:20.600267 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:20.600714 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:20.601128 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:20.618214 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Getting quotas for project e62c12b7398343648a02ef5c64cda2b1. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:47:20.622129 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Getting quotas for user 7aa8ef56dea147fe9594ac6ae812aebb and project e62c12b7398343648a02ef5c64cda2b1. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:47:20.677941 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Going to run 1 instances... {{(pid=119046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:47:20.680148 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3c400c3e-40a6-4b7c-a956-2f6c7298b9a5',volume_size=None,volume_type=None)] {{(pid=119046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:47:20.806795 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d5329a84-f8db-4963-bbd7-0be5b9ed6690 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.704718 Oct 27 17:47:20.807439 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 599/1226] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:47:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:47:20.818489 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-2c0fa1a5-74a7-4301-a8f2-6f7308d1cb97 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:20.819096 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-2c0fa1a5-74a7-4301-a8f2-6f7308d1cb97 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:20.872342 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-2c0fa1a5-74a7-4301-a8f2-6f7308d1cb97 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:20.879267 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-2c0fa1a5-74a7-4301-a8f2-6f7308d1cb97 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1095 microversion: 2.1 time: 0.064634 Oct 27 17:47:20.880024 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 628/1227] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:20 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:21.903442 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-c1a654c0-9aba-4603-be33-73c37e2ac1eb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:21.904070 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c1a654c0-9aba-4603-be33-73c37e2ac1eb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:21.910299 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c1a654c0-9aba-4603-be33-73c37e2ac1eb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:21.910784 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c1a654c0-9aba-4603-be33-73c37e2ac1eb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:21.911217 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c1a654c0-9aba-4603-be33-73c37e2ac1eb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:21.912014 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c1a654c0-9aba-4603-be33-73c37e2ac1eb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:21.912391 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c1a654c0-9aba-4603-be33-73c37e2ac1eb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:21.912809 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c1a654c0-9aba-4603-be33-73c37e2ac1eb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:21.996885 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-c1a654c0-9aba-4603-be33-73c37e2ac1eb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:22.004684 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-c1a654c0-9aba-4603-be33-73c37e2ac1eb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1211 microversion: 2.1 time: 0.106780 Oct 27 17:47:22.005252 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 600/1228] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:21 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:23.028421 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-073d017c-99df-41ee-af16-a12ce80323c9 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:23.029034 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-073d017c-99df-41ee-af16-a12ce80323c9 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:23.039313 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-073d017c-99df-41ee-af16-a12ce80323c9 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:23.040647 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-073d017c-99df-41ee-af16-a12ce80323c9 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:23.041088 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-073d017c-99df-41ee-af16-a12ce80323c9 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:23.041792 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-073d017c-99df-41ee-af16-a12ce80323c9 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:23.042247 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-073d017c-99df-41ee-af16-a12ce80323c9 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:23.042671 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-073d017c-99df-41ee-af16-a12ce80323c9 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:23.179764 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-073d017c-99df-41ee-af16-a12ce80323c9 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:23.188252 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-073d017c-99df-41ee-af16-a12ce80323c9 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1267 microversion: 2.1 time: 0.164345 Oct 27 17:47:23.188822 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 629/1229] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:23 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:23.302758 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-761826f3-4186-4034-8c59-b0fc99ceb90b req-be0f8e52-a678-4e38-8d51-2106ae289bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b", "tag": "c8314d68-3215-42b5-a8e1-79d5b0f4dba7"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:47:23.314933 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-761826f3-4186-4034-8c59-b0fc99ceb90b req-be0f8e52-a678-4e38-8d51-2106ae289bf0 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:23.315416 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-761826f3-4186-4034-8c59-b0fc99ceb90b req-be0f8e52-a678-4e38-8d51-2106ae289bf0 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:23.315878 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-761826f3-4186-4034-8c59-b0fc99ceb90b req-be0f8e52-a678-4e38-8d51-2106ae289bf0 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:23.327433 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-761826f3-4186-4034-8c59-b0fc99ceb90b req-be0f8e52-a678-4e38-8d51-2106ae289bf0 service nova] Creating event network-changed:c8314d68-3215-42b5-a8e1-79d5b0f4dba7 for instance 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b on hv-cinder-86283 Oct 27 17:47:23.332236 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-761826f3-4186-4034-8c59-b0fc99ceb90b req-be0f8e52-a678-4e38-8d51-2106ae289bf0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033168 Oct 27 17:47:23.332831 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 601/1230] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:47:24.210970 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-5d013ecf-10e3-444d-a747-a2f66c7b9789 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:24.212238 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-5d013ecf-10e3-444d-a747-a2f66c7b9789 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:24.218688 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5d013ecf-10e3-444d-a747-a2f66c7b9789 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:24.219172 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5d013ecf-10e3-444d-a747-a2f66c7b9789 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:24.219604 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5d013ecf-10e3-444d-a747-a2f66c7b9789 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:24.220323 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5d013ecf-10e3-444d-a747-a2f66c7b9789 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:24.220775 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5d013ecf-10e3-444d-a747-a2f66c7b9789 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:24.221198 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-5d013ecf-10e3-444d-a747-a2f66c7b9789 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:24.348982 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-5d013ecf-10e3-444d-a747-a2f66c7b9789 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:24.356929 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-5d013ecf-10e3-444d-a747-a2f66c7b9789 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1267 microversion: 2.1 time: 0.149866 Oct 27 17:47:24.357489 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 630/1231] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:24 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:25.380702 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-00bef012-fb27-41fb-bd37-1df744578dd5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:25.381401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-00bef012-fb27-41fb-bd37-1df744578dd5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:25.388152 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-00bef012-fb27-41fb-bd37-1df744578dd5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:25.388633 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-00bef012-fb27-41fb-bd37-1df744578dd5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:25.389065 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-00bef012-fb27-41fb-bd37-1df744578dd5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:25.389746 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-00bef012-fb27-41fb-bd37-1df744578dd5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:25.390191 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-00bef012-fb27-41fb-bd37-1df744578dd5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:25.390608 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-00bef012-fb27-41fb-bd37-1df744578dd5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:25.524383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-00bef012-fb27-41fb-bd37-1df744578dd5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:25.532021 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-00bef012-fb27-41fb-bd37-1df744578dd5 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1267 microversion: 2.1 time: 0.156023 Oct 27 17:47:25.532583 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 602/1232] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:25 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:26.554400 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-17978d09-5d54-4037-bd6a-85b7342cb4fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:26.555010 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-17978d09-5d54-4037-bd6a-85b7342cb4fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:26.561580 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-17978d09-5d54-4037-bd6a-85b7342cb4fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:26.562062 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-17978d09-5d54-4037-bd6a-85b7342cb4fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:26.562499 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-17978d09-5d54-4037-bd6a-85b7342cb4fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:26.563188 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-17978d09-5d54-4037-bd6a-85b7342cb4fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:26.563643 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-17978d09-5d54-4037-bd6a-85b7342cb4fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:26.564094 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-17978d09-5d54-4037-bd6a-85b7342cb4fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:26.698426 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-17978d09-5d54-4037-bd6a-85b7342cb4fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:26.706445 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-17978d09-5d54-4037-bd6a-85b7342cb4fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1267 microversion: 2.1 time: 0.155988 Oct 27 17:47:26.707013 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 631/1233] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:26 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:27.728646 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-063c6c83-ecde-42f6-8378-830ccad5cdca tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:27.729189 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-063c6c83-ecde-42f6-8378-830ccad5cdca tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:27.735839 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-063c6c83-ecde-42f6-8378-830ccad5cdca tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:27.736310 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-063c6c83-ecde-42f6-8378-830ccad5cdca tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:27.736734 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-063c6c83-ecde-42f6-8378-830ccad5cdca tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:27.737408 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-063c6c83-ecde-42f6-8378-830ccad5cdca tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:27.737851 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-063c6c83-ecde-42f6-8378-830ccad5cdca tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:27.738264 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-063c6c83-ecde-42f6-8378-830ccad5cdca tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:27.867594 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-063c6c83-ecde-42f6-8378-830ccad5cdca tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:27.875083 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-063c6c83-ecde-42f6-8378-830ccad5cdca tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1267 microversion: 2.1 time: 0.150534 Oct 27 17:47:27.875643 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 603/1234] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:27 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:28.898230 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-97bacf84-0653-42a5-93cd-e14fc3ae6812 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:28.898783 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-97bacf84-0653-42a5-93cd-e14fc3ae6812 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:28.905812 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97bacf84-0653-42a5-93cd-e14fc3ae6812 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:28.906299 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97bacf84-0653-42a5-93cd-e14fc3ae6812 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:28.906743 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97bacf84-0653-42a5-93cd-e14fc3ae6812 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:28.907436 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97bacf84-0653-42a5-93cd-e14fc3ae6812 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:28.907937 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97bacf84-0653-42a5-93cd-e14fc3ae6812 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:28.908368 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-97bacf84-0653-42a5-93cd-e14fc3ae6812 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:29.035056 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-97bacf84-0653-42a5-93cd-e14fc3ae6812 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:29.043356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-97bacf84-0653-42a5-93cd-e14fc3ae6812 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1267 microversion: 2.1 time: 0.149449 Oct 27 17:47:29.043962 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 632/1235] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:28 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:30.065955 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-d249ccb6-55d9-4c86-b025-71ca533ae9aa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:30.066566 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-d249ccb6-55d9-4c86-b025-71ca533ae9aa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:30.073542 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d249ccb6-55d9-4c86-b025-71ca533ae9aa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:30.074022 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d249ccb6-55d9-4c86-b025-71ca533ae9aa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:30.074457 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d249ccb6-55d9-4c86-b025-71ca533ae9aa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:30.075141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d249ccb6-55d9-4c86-b025-71ca533ae9aa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:30.075598 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d249ccb6-55d9-4c86-b025-71ca533ae9aa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:30.076044 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-d249ccb6-55d9-4c86-b025-71ca533ae9aa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:30.206452 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-d249ccb6-55d9-4c86-b025-71ca533ae9aa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:30.214659 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-d249ccb6-55d9-4c86-b025-71ca533ae9aa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1267 microversion: 2.1 time: 0.152616 Oct 27 17:47:30.215228 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 604/1236] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:30 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:31.237126 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a87722ae-cb5f-4058-ab4c-0fb11061fee8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:31.237680 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a87722ae-cb5f-4058-ab4c-0fb11061fee8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:31.240130 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:47:31.245748 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a87722ae-cb5f-4058-ab4c-0fb11061fee8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:31.246228 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a87722ae-cb5f-4058-ab4c-0fb11061fee8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:31.246659 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a87722ae-cb5f-4058-ab4c-0fb11061fee8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:31.247348 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a87722ae-cb5f-4058-ab4c-0fb11061fee8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:31.247829 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a87722ae-cb5f-4058-ab4c-0fb11061fee8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:31.248253 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a87722ae-cb5f-4058-ab4c-0fb11061fee8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:31.378530 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a87722ae-cb5f-4058-ab4c-0fb11061fee8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:31.386249 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a87722ae-cb5f-4058-ab4c-0fb11061fee8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1267 microversion: 2.1 time: 0.153060 Oct 27 17:47:31.386804 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 633/1237] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:31 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:32.409197 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-60811438-d249-4d98-aca5-9343b3fcd1cb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:32.409815 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-60811438-d249-4d98-aca5-9343b3fcd1cb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:32.411796 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=2 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:47:32.412483 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=6 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:47:32.419334 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60811438-d249-4d98-aca5-9343b3fcd1cb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:32.419915 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60811438-d249-4d98-aca5-9343b3fcd1cb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:32.420358 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60811438-d249-4d98-aca5-9343b3fcd1cb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:32.421046 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60811438-d249-4d98-aca5-9343b3fcd1cb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:32.421501 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60811438-d249-4d98-aca5-9343b3fcd1cb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:32.421923 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-60811438-d249-4d98-aca5-9343b3fcd1cb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:32.550523 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-60811438-d249-4d98-aca5-9343b3fcd1cb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:32.558814 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-60811438-d249-4d98-aca5-9343b3fcd1cb tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1267 microversion: 2.1 time: 0.153604 Oct 27 17:47:32.559383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 605/1238] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:32 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:33.581348 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-cec7d758-38a6-48bc-93fa-76efcffedfa2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:33.582009 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-cec7d758-38a6-48bc-93fa-76efcffedfa2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:33.588501 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cec7d758-38a6-48bc-93fa-76efcffedfa2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:33.588980 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cec7d758-38a6-48bc-93fa-76efcffedfa2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:33.589408 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cec7d758-38a6-48bc-93fa-76efcffedfa2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:33.590090 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cec7d758-38a6-48bc-93fa-76efcffedfa2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:33.590535 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cec7d758-38a6-48bc-93fa-76efcffedfa2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:33.590951 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-cec7d758-38a6-48bc-93fa-76efcffedfa2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:33.716792 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-cec7d758-38a6-48bc-93fa-76efcffedfa2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:33.724360 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-cec7d758-38a6-48bc-93fa-76efcffedfa2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1267 microversion: 2.1 time: 0.146898 Oct 27 17:47:33.724927 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 634/1239] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:33 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:34.747155 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-81a9e5ee-c3ed-4342-8770-2f9b213cc15b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:34.747798 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-81a9e5ee-c3ed-4342-8770-2f9b213cc15b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:34.754219 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81a9e5ee-c3ed-4342-8770-2f9b213cc15b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:34.754694 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81a9e5ee-c3ed-4342-8770-2f9b213cc15b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:34.755130 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81a9e5ee-c3ed-4342-8770-2f9b213cc15b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:34.755863 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81a9e5ee-c3ed-4342-8770-2f9b213cc15b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:34.756314 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81a9e5ee-c3ed-4342-8770-2f9b213cc15b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:34.756734 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-81a9e5ee-c3ed-4342-8770-2f9b213cc15b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:34.887500 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-81a9e5ee-c3ed-4342-8770-2f9b213cc15b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:34.895111 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-81a9e5ee-c3ed-4342-8770-2f9b213cc15b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1267 microversion: 2.1 time: 0.151853 Oct 27 17:47:34.895675 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 606/1240] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:34 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:35.917843 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a030ee0b-6a82-4a78-85a5-70ac6972a07b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:35.918482 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a030ee0b-6a82-4a78-85a5-70ac6972a07b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:35.924845 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a030ee0b-6a82-4a78-85a5-70ac6972a07b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:35.925352 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a030ee0b-6a82-4a78-85a5-70ac6972a07b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:35.925779 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a030ee0b-6a82-4a78-85a5-70ac6972a07b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:35.926491 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a030ee0b-6a82-4a78-85a5-70ac6972a07b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:35.926943 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a030ee0b-6a82-4a78-85a5-70ac6972a07b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:35.927360 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a030ee0b-6a82-4a78-85a5-70ac6972a07b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:35.967537 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-4645080e-ae21-49a0-8b10-05f135071d9c req-25ae48c1-8c50-4360-8b3e-40d20d5b1d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b", "name": "network-vif-plugged", "status": "completed", "tag": "c8314d68-3215-42b5-a8e1-79d5b0f4dba7"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:47:35.977713 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-4645080e-ae21-49a0-8b10-05f135071d9c req-25ae48c1-8c50-4360-8b3e-40d20d5b1d1c service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:35.978152 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-4645080e-ae21-49a0-8b10-05f135071d9c req-25ae48c1-8c50-4360-8b3e-40d20d5b1d1c service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:35.978767 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-4645080e-ae21-49a0-8b10-05f135071d9c req-25ae48c1-8c50-4360-8b3e-40d20d5b1d1c service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:35.990563 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-4645080e-ae21-49a0-8b10-05f135071d9c req-25ae48c1-8c50-4360-8b3e-40d20d5b1d1c service nova] Creating event network-vif-plugged:c8314d68-3215-42b5-a8e1-79d5b0f4dba7 for instance 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b on hv-cinder-86283 Oct 27 17:47:35.996278 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-4645080e-ae21-49a0-8b10-05f135071d9c req-25ae48c1-8c50-4360-8b3e-40d20d5b1d1c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032245 Oct 27 17:47:35.997058 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 607/1241] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:47:36.063918 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-a030ee0b-6a82-4a78-85a5-70ac6972a07b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:36.072603 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a030ee0b-6a82-4a78-85a5-70ac6972a07b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1267 microversion: 2.1 time: 0.159487 Oct 27 17:47:36.073173 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 635/1242] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:35 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:37.096659 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-9e27efac-cc30-4ce9-8677-6009a6c53d7a tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:37.097357 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-9e27efac-cc30-4ce9-8677-6009a6c53d7a tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:37.104075 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e27efac-cc30-4ce9-8677-6009a6c53d7a tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:37.104557 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e27efac-cc30-4ce9-8677-6009a6c53d7a tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:37.104991 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e27efac-cc30-4ce9-8677-6009a6c53d7a tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:37.105929 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e27efac-cc30-4ce9-8677-6009a6c53d7a tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:37.106380 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e27efac-cc30-4ce9-8677-6009a6c53d7a tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:37.106800 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-9e27efac-cc30-4ce9-8677-6009a6c53d7a tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:37.234658 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-9e27efac-cc30-4ce9-8677-6009a6c53d7a tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:37.242339 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-9e27efac-cc30-4ce9-8677-6009a6c53d7a tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1267 microversion: 2.1 time: 0.150376 Oct 27 17:47:37.242919 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 608/1243] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:37 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:38.265401 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-b26edcc4-2de0-4708-80e7-3d60b3b832c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:38.266086 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-b26edcc4-2de0-4708-80e7-3d60b3b832c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:38.272435 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b26edcc4-2de0-4708-80e7-3d60b3b832c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:38.272907 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b26edcc4-2de0-4708-80e7-3d60b3b832c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:38.273336 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b26edcc4-2de0-4708-80e7-3d60b3b832c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:38.274678 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b26edcc4-2de0-4708-80e7-3d60b3b832c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:38.275126 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b26edcc4-2de0-4708-80e7-3d60b3b832c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:38.275544 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-b26edcc4-2de0-4708-80e7-3d60b3b832c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:38.407616 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-b26edcc4-2de0-4708-80e7-3d60b3b832c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:38.415874 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-b26edcc4-2de0-4708-80e7-3d60b3b832c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1454 microversion: 2.1 time: 0.154396 Oct 27 17:47:38.416432 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 636/1244] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:38 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:47:38.439222 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ad45809b-5651-4a1f-9967-2fa07b2f43b4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:47:38.439920 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ad45809b-5651-4a1f-9967-2fa07b2f43b4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:47:38.446414 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ad45809b-5651-4a1f-9967-2fa07b2f43b4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:38.446886 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ad45809b-5651-4a1f-9967-2fa07b2f43b4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:38.447315 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ad45809b-5651-4a1f-9967-2fa07b2f43b4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:38.448031 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ad45809b-5651-4a1f-9967-2fa07b2f43b4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:38.448479 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ad45809b-5651-4a1f-9967-2fa07b2f43b4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:38.448897 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ad45809b-5651-4a1f-9967-2fa07b2f43b4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:38.586061 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-ad45809b-5651-4a1f-9967-2fa07b2f43b4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:47:38.594288 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ad45809b-5651-4a1f-9967-2fa07b2f43b4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1454 microversion: 2.1 time: 0.159466 Oct 27 17:47:38.594847 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 609/1245] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:47:38 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:47:40.383561 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-289ebb5c-631b-48ab-b69c-483ee6161575 req-1bddb5f4-b20a-4617-a646-072bf9f94751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b", "tag": "c8314d68-3215-42b5-a8e1-79d5b0f4dba7"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:47:40.393430 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-289ebb5c-631b-48ab-b69c-483ee6161575 req-1bddb5f4-b20a-4617-a646-072bf9f94751 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:47:40.393902 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-289ebb5c-631b-48ab-b69c-483ee6161575 req-1bddb5f4-b20a-4617-a646-072bf9f94751 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:47:40.394356 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-289ebb5c-631b-48ab-b69c-483ee6161575 req-1bddb5f4-b20a-4617-a646-072bf9f94751 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:47:40.407126 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-289ebb5c-631b-48ab-b69c-483ee6161575 req-1bddb5f4-b20a-4617-a646-072bf9f94751 service nova] Creating event network-changed:c8314d68-3215-42b5-a8e1-79d5b0f4dba7 for instance 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b on hv-cinder-86283 Oct 27 17:47:40.412316 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-289ebb5c-631b-48ab-b69c-483ee6161575 req-1bddb5f4-b20a-4617-a646-072bf9f94751 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032379 Oct 27 17:47:40.413088 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 637/1246] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:49:40.227077 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:49:40.228482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=74 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:49:40.234827 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-369405931", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1501870066", "security_groups": [{"name": "tempest-secgroup-smoke-1378820443"}], "block_device_mapping_v2": [{"uuid": "735e9b17-bcf2-4d4c-b619-8a7f1969dd52", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cacaec05-05b8-4422-92f4-e7ab38239f98"}]}} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:49:40.344230 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.network.neutron [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] validate_networks() for [('cacaec05-05b8-4422-92f4-e7ab38239f98', None, None, None, None, None)] {{(pid=119046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 17:49:40.789332 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Flavor limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 17:49:40.789909 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Image limits 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 17:49:40.790381 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Flavor pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 17:49:40.790780 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Image pref 0:0:0 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 17:49:40.791183 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.virt.hardware [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 17:49:40.800189 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:40.800661 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:40.801084 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:40.801797 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:40.802241 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:40.802654 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:40.819675 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Getting quotas for project e62c12b7398343648a02ef5c64cda2b1. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 17:49:40.824403 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.quota [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Getting quotas for user 7aa8ef56dea147fe9594ac6ae812aebb and project e62c12b7398343648a02ef5c64cda2b1. Resources: {'instances', 'cores', 'ram'} {{(pid=119046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 17:49:40.881946 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Going to run 1 instances... {{(pid=119046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 17:49:40.884660 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='735e9b17-bcf2-4d4c-b619-8a7f1969dd52',volume_size=None,volume_type=None)] {{(pid=119046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 17:49:41.009980 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-7459f14b-e2e3-42ac-b36b-6a95b8c6340c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.784131 Oct 27 17:49:41.010621 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 610/1247] 10.222.0.36 () {60 vars in 1147 bytes} [Thu Oct 27 17:49:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 17:49:41.020229 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:49:41.020970 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:49:41.026586 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-c5edff23-2f6e-4005-b5d8-d06bd6d88798 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:49:41.027288 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-c5edff23-2f6e-4005-b5d8-d06bd6d88798 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:49:41.084855 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-c5edff23-2f6e-4005-b5d8-d06bd6d88798 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:49:41.091856 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-c5edff23-2f6e-4005-b5d8-d06bd6d88798 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1094 microversion: 2.1 time: 0.073711 Oct 27 17:49:41.092752 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 638/1248] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:49:41 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:49:42.116896 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-40d065a8-1024-46b6-9faf-eb9bc521f529 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:49:42.117539 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-40d065a8-1024-46b6-9faf-eb9bc521f529 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:49:42.124733 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-40d065a8-1024-46b6-9faf-eb9bc521f529 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:42.125221 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-40d065a8-1024-46b6-9faf-eb9bc521f529 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:42.125474 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-40d065a8-1024-46b6-9faf-eb9bc521f529 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:42.126518 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-40d065a8-1024-46b6-9faf-eb9bc521f529 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:42.126863 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-40d065a8-1024-46b6-9faf-eb9bc521f529 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:42.127283 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-40d065a8-1024-46b6-9faf-eb9bc521f529 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:42.197827 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-40d065a8-1024-46b6-9faf-eb9bc521f529 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:49:42.205911 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-40d065a8-1024-46b6-9faf-eb9bc521f529 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1200 microversion: 2.1 time: 0.093178 Oct 27 17:49:42.207021 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 611/1249] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:49:42 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1200 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:49:43.230633 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-f4a76830-b4e0-4063-949d-4f5373f4fc3d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:49:43.231243 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-f4a76830-b4e0-4063-949d-4f5373f4fc3d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:49:43.238300 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4a76830-b4e0-4063-949d-4f5373f4fc3d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:43.238776 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4a76830-b4e0-4063-949d-4f5373f4fc3d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:43.239183 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4a76830-b4e0-4063-949d-4f5373f4fc3d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:43.239908 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4a76830-b4e0-4063-949d-4f5373f4fc3d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:43.240352 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4a76830-b4e0-4063-949d-4f5373f4fc3d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:43.240767 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-f4a76830-b4e0-4063-949d-4f5373f4fc3d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:43.370386 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-f4a76830-b4e0-4063-949d-4f5373f4fc3d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:49:43.378201 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-f4a76830-b4e0-4063-949d-4f5373f4fc3d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1266 microversion: 2.1 time: 0.152167 Oct 27 17:49:43.378774 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 639/1250] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:49:43 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:49:43.526155 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-76d34785-3b0a-4299-8b78-2fdf3f792565 req-bc9cb772-5003-4b21-8700-48ec43394dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eecc431d-c315-47ca-835b-6ea0a2ff168d", "tag": "b6823ae7-fbf5-4aa7-b58d-9791661e2ad8"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:49:43.536747 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-76d34785-3b0a-4299-8b78-2fdf3f792565 req-bc9cb772-5003-4b21-8700-48ec43394dec service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:43.537492 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-76d34785-3b0a-4299-8b78-2fdf3f792565 req-bc9cb772-5003-4b21-8700-48ec43394dec service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:43.537926 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-76d34785-3b0a-4299-8b78-2fdf3f792565 req-bc9cb772-5003-4b21-8700-48ec43394dec service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:43.548988 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-76d34785-3b0a-4299-8b78-2fdf3f792565 req-bc9cb772-5003-4b21-8700-48ec43394dec service nova] Creating event network-changed:b6823ae7-fbf5-4aa7-b58d-9791661e2ad8 for instance eecc431d-c315-47ca-835b-6ea0a2ff168d on hv-cinder-86283 Oct 27 17:49:43.553881 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-76d34785-3b0a-4299-8b78-2fdf3f792565 req-bc9cb772-5003-4b21-8700-48ec43394dec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032067 Oct 27 17:49:43.554484 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 612/1251] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:49:44.401212 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-aebbf291-1500-4585-9edf-65afd84aee1b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:49:44.401837 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-aebbf291-1500-4585-9edf-65afd84aee1b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:49:44.408292 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aebbf291-1500-4585-9edf-65afd84aee1b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:44.408776 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aebbf291-1500-4585-9edf-65afd84aee1b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:44.409211 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aebbf291-1500-4585-9edf-65afd84aee1b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:44.409900 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aebbf291-1500-4585-9edf-65afd84aee1b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:44.410358 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aebbf291-1500-4585-9edf-65afd84aee1b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:44.410781 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-aebbf291-1500-4585-9edf-65afd84aee1b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:44.542260 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-aebbf291-1500-4585-9edf-65afd84aee1b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:49:44.549958 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-aebbf291-1500-4585-9edf-65afd84aee1b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1266 microversion: 2.1 time: 0.152667 Oct 27 17:49:44.550537 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 640/1252] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:49:44 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:49:45.573588 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-0134e01b-b720-428d-b48a-70335a547a06 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:49:45.574424 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-0134e01b-b720-428d-b48a-70335a547a06 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:49:45.580635 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0134e01b-b720-428d-b48a-70335a547a06 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:45.581108 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0134e01b-b720-428d-b48a-70335a547a06 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:45.581538 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0134e01b-b720-428d-b48a-70335a547a06 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:45.582225 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0134e01b-b720-428d-b48a-70335a547a06 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:45.582664 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0134e01b-b720-428d-b48a-70335a547a06 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:45.583078 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-0134e01b-b720-428d-b48a-70335a547a06 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:45.713389 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-0134e01b-b720-428d-b48a-70335a547a06 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:49:45.721207 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-0134e01b-b720-428d-b48a-70335a547a06 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1266 microversion: 2.1 time: 0.153103 Oct 27 17:49:45.721778 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 613/1253] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:49:45 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:49:46.744906 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-de1832fb-8f1a-4e43-9376-542cd30d32b0 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:49:46.745520 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-de1832fb-8f1a-4e43-9376-542cd30d32b0 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:49:46.751633 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-de1832fb-8f1a-4e43-9376-542cd30d32b0 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:46.752144 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-de1832fb-8f1a-4e43-9376-542cd30d32b0 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:46.752578 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-de1832fb-8f1a-4e43-9376-542cd30d32b0 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:46.753261 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-de1832fb-8f1a-4e43-9376-542cd30d32b0 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:46.753713 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-de1832fb-8f1a-4e43-9376-542cd30d32b0 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:46.754134 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-de1832fb-8f1a-4e43-9376-542cd30d32b0 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:46.881265 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-de1832fb-8f1a-4e43-9376-542cd30d32b0 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:49:46.888872 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-de1832fb-8f1a-4e43-9376-542cd30d32b0 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1266 microversion: 2.1 time: 0.148453 Oct 27 17:49:46.889430 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 641/1254] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:49:46 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:49:47.911830 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-e192eb1b-2b5d-4d31-b69d-6454882019bd tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:49:47.912358 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-e192eb1b-2b5d-4d31-b69d-6454882019bd tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:49:47.918771 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e192eb1b-2b5d-4d31-b69d-6454882019bd tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:47.919255 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e192eb1b-2b5d-4d31-b69d-6454882019bd tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:47.919689 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e192eb1b-2b5d-4d31-b69d-6454882019bd tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:47.920394 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e192eb1b-2b5d-4d31-b69d-6454882019bd tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:47.920845 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e192eb1b-2b5d-4d31-b69d-6454882019bd tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:47.921270 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-e192eb1b-2b5d-4d31-b69d-6454882019bd tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:48.051482 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-e192eb1b-2b5d-4d31-b69d-6454882019bd tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:49:48.060116 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-e192eb1b-2b5d-4d31-b69d-6454882019bd tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1266 microversion: 2.1 time: 0.152265 Oct 27 17:49:48.060690 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 614/1255] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:49:47 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:49:49.081690 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-64899a6d-8789-4f26-a8c0-27a41ddeb91d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:49:49.082337 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-64899a6d-8789-4f26-a8c0-27a41ddeb91d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:49:49.089180 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-64899a6d-8789-4f26-a8c0-27a41ddeb91d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:49.089657 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-64899a6d-8789-4f26-a8c0-27a41ddeb91d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:49.090088 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-64899a6d-8789-4f26-a8c0-27a41ddeb91d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:49.090777 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-64899a6d-8789-4f26-a8c0-27a41ddeb91d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:49.091230 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-64899a6d-8789-4f26-a8c0-27a41ddeb91d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:49.091648 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-64899a6d-8789-4f26-a8c0-27a41ddeb91d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:49.222224 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-64899a6d-8789-4f26-a8c0-27a41ddeb91d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:49:49.229927 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-64899a6d-8789-4f26-a8c0-27a41ddeb91d tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1266 microversion: 2.1 time: 0.152125 Oct 27 17:49:49.230488 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 642/1256] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:49:49 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:49:50.253295 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-627b4afc-f9f3-48fc-ac46-35fb4a6db2e7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:49:50.253906 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-627b4afc-f9f3-48fc-ac46-35fb4a6db2e7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:49:50.260390 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-627b4afc-f9f3-48fc-ac46-35fb4a6db2e7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:50.260865 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-627b4afc-f9f3-48fc-ac46-35fb4a6db2e7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:50.261293 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-627b4afc-f9f3-48fc-ac46-35fb4a6db2e7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:50.261972 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-627b4afc-f9f3-48fc-ac46-35fb4a6db2e7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:50.262421 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-627b4afc-f9f3-48fc-ac46-35fb4a6db2e7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:50.262840 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-627b4afc-f9f3-48fc-ac46-35fb4a6db2e7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:50.388711 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-627b4afc-f9f3-48fc-ac46-35fb4a6db2e7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:49:50.396383 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-627b4afc-f9f3-48fc-ac46-35fb4a6db2e7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1266 microversion: 2.1 time: 0.147020 Oct 27 17:49:50.396945 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 615/1257] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:49:50 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:49:51.419740 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-4fb6759b-0e70-4bf3-834e-60d26b55f175 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:49:51.420359 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-4fb6759b-0e70-4bf3-834e-60d26b55f175 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:49:51.422697 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell0:SELECT=2 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:49:51.428218 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fb6759b-0e70-4bf3-834e-60d26b55f175 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:51.428695 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fb6759b-0e70-4bf3-834e-60d26b55f175 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:51.429164 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fb6759b-0e70-4bf3-834e-60d26b55f175 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:51.429945 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fb6759b-0e70-4bf3-834e-60d26b55f175 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:51.430298 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fb6759b-0e70-4bf3-834e-60d26b55f175 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:51.430717 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-4fb6759b-0e70-4bf3-834e-60d26b55f175 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:51.557534 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-4fb6759b-0e70-4bf3-834e-60d26b55f175 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:49:51.565097 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-4fb6759b-0e70-4bf3-834e-60d26b55f175 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1266 microversion: 2.1 time: 0.149917 Oct 27 17:49:51.565655 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 643/1258] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:49:51 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:49:52.587604 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-1259c366-e104-4316-969c-b898a278e901 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:49:52.588251 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-1259c366-e104-4316-969c-b898a278e901 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:49:52.590301 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=2 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:49:52.591035 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell0:SELECT=6 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:49:52.596867 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1259c366-e104-4316-969c-b898a278e901 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:52.597356 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1259c366-e104-4316-969c-b898a278e901 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:52.597785 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1259c366-e104-4316-969c-b898a278e901 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:52.598626 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1259c366-e104-4316-969c-b898a278e901 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:52.599073 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1259c366-e104-4316-969c-b898a278e901 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:52.599493 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-1259c366-e104-4316-969c-b898a278e901 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:52.731318 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-1259c366-e104-4316-969c-b898a278e901 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:49:52.739193 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-1259c366-e104-4316-969c-b898a278e901 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1266 microversion: 2.1 time: 0.155555 Oct 27 17:49:52.739763 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 616/1259] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:49:52 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:49:53.763102 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-d462c811-48ea-45b7-be71-fdc30f1527d7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:49:53.763476 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-d462c811-48ea-45b7-be71-fdc30f1527d7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:49:53.771088 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d462c811-48ea-45b7-be71-fdc30f1527d7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:53.771606 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d462c811-48ea-45b7-be71-fdc30f1527d7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:53.772082 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d462c811-48ea-45b7-be71-fdc30f1527d7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:53.772784 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d462c811-48ea-45b7-be71-fdc30f1527d7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:53.773237 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d462c811-48ea-45b7-be71-fdc30f1527d7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:53.773663 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-d462c811-48ea-45b7-be71-fdc30f1527d7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:53.906200 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-d462c811-48ea-45b7-be71-fdc30f1527d7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:49:53.913904 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-d462c811-48ea-45b7-be71-fdc30f1527d7 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1266 microversion: 2.1 time: 0.155710 Oct 27 17:49:53.914469 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 644/1260] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:49:53 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:49:54.638332 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [req-896675b5-4759-4eda-b39a-33549226f064 req-6524f23e-c8a3-4be6-a98a-2191b3ceccc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecc431d-c315-47ca-835b-6ea0a2ff168d", "name": "network-vif-plugged", "status": "completed", "tag": "b6823ae7-fbf5-4aa7-b58d-9791661e2ad8"}]} {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:49:54.647815 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-896675b5-4759-4eda-b39a-33549226f064 req-6524f23e-c8a3-4be6-a98a-2191b3ceccc0 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:54.648286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-896675b5-4759-4eda-b39a-33549226f064 req-6524f23e-c8a3-4be6-a98a-2191b3ceccc0 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:54.648717 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [req-896675b5-4759-4eda-b39a-33549226f064 req-6524f23e-c8a3-4be6-a98a-2191b3ceccc0 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:54.660284 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.compute.server_external_events [req-896675b5-4759-4eda-b39a-33549226f064 req-6524f23e-c8a3-4be6-a98a-2191b3ceccc0 service nova] Creating event network-vif-plugged:b6823ae7-fbf5-4aa7-b58d-9791661e2ad8 for instance eecc431d-c315-47ca-835b-6ea0a2ff168d on hv-cinder-86283 Oct 27 17:49:54.665141 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [req-896675b5-4759-4eda-b39a-33549226f064 req-6524f23e-c8a3-4be6-a98a-2191b3ceccc0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102352 Oct 27 17:49:54.665711 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 617/1261] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:49:54.936354 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-df18767b-2761-443c-9590-1a238332f5c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:49:54.937089 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-df18767b-2761-443c-9590-1a238332f5c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:49:54.943445 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df18767b-2761-443c-9590-1a238332f5c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:54.943965 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df18767b-2761-443c-9590-1a238332f5c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:54.944401 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df18767b-2761-443c-9590-1a238332f5c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:54.945095 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df18767b-2761-443c-9590-1a238332f5c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:54.945549 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df18767b-2761-443c-9590-1a238332f5c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:54.945970 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-df18767b-2761-443c-9590-1a238332f5c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:55.074439 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-df18767b-2761-443c-9590-1a238332f5c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:49:55.082134 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-df18767b-2761-443c-9590-1a238332f5c2 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1266 microversion: 2.1 time: 0.149764 Oct 27 17:49:55.082702 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 645/1262] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:49:54 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:49:56.106981 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-c3e251b3-9f0f-4e8e-ac79-0065798575f8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:49:56.107961 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-c3e251b3-9f0f-4e8e-ac79-0065798575f8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:49:56.114080 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c3e251b3-9f0f-4e8e-ac79-0065798575f8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:56.114561 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c3e251b3-9f0f-4e8e-ac79-0065798575f8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:56.114994 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c3e251b3-9f0f-4e8e-ac79-0065798575f8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:56.115681 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c3e251b3-9f0f-4e8e-ac79-0065798575f8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:56.116157 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c3e251b3-9f0f-4e8e-ac79-0065798575f8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:56.116581 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-c3e251b3-9f0f-4e8e-ac79-0065798575f8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:56.246153 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-c3e251b3-9f0f-4e8e-ac79-0065798575f8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:49:56.253829 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-c3e251b3-9f0f-4e8e-ac79-0065798575f8 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1266 microversion: 2.1 time: 0.152166 Oct 27 17:49:56.254390 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 618/1263] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:49:56 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:49:57.276302 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-29c9ca36-9e88-4bfa-9a5f-2cc0192d7b67 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:49:57.276919 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-29c9ca36-9e88-4bfa-9a5f-2cc0192d7b67 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:49:57.283295 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29c9ca36-9e88-4bfa-9a5f-2cc0192d7b67 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:57.283864 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29c9ca36-9e88-4bfa-9a5f-2cc0192d7b67 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:57.284305 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29c9ca36-9e88-4bfa-9a5f-2cc0192d7b67 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:57.284997 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29c9ca36-9e88-4bfa-9a5f-2cc0192d7b67 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:57.285444 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29c9ca36-9e88-4bfa-9a5f-2cc0192d7b67 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:57.285864 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-29c9ca36-9e88-4bfa-9a5f-2cc0192d7b67 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:57.412376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-29c9ca36-9e88-4bfa-9a5f-2cc0192d7b67 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:49:57.421121 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-29c9ca36-9e88-4bfa-9a5f-2cc0192d7b67 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1454 microversion: 2.1 time: 0.149273 Oct 27 17:49:57.421684 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 646/1264] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:49:57 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:49:57.442768 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-191f12c9-5501-4efe-ac14-112a0e2a614c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:49:57.443416 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-191f12c9-5501-4efe-ac14-112a0e2a614c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:49:57.449898 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-191f12c9-5501-4efe-ac14-112a0e2a614c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:57.450382 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-191f12c9-5501-4efe-ac14-112a0e2a614c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:57.450819 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-191f12c9-5501-4efe-ac14-112a0e2a614c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:57.451562 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-191f12c9-5501-4efe-ac14-112a0e2a614c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:57.453077 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-191f12c9-5501-4efe-ac14-112a0e2a614c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:57.453827 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-191f12c9-5501-4efe-ac14-112a0e2a614c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:57.590514 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-191f12c9-5501-4efe-ac14-112a0e2a614c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:49:57.598248 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-191f12c9-5501-4efe-ac14-112a0e2a614c tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1454 microversion: 2.1 time: 0.159345 Oct 27 17:49:57.598833 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 619/1265] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:49:57 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:49:59.494569 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-bde17d10-eb96-4d57-98bd-3316f8b140d3 req-6473d31e-3088-47f7-b1a5-264426297795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eecc431d-c315-47ca-835b-6ea0a2ff168d", "tag": "b6823ae7-fbf5-4aa7-b58d-9791661e2ad8"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:49:59.504143 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-bde17d10-eb96-4d57-98bd-3316f8b140d3 req-6473d31e-3088-47f7-b1a5-264426297795 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:49:59.504614 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-bde17d10-eb96-4d57-98bd-3316f8b140d3 req-6473d31e-3088-47f7-b1a5-264426297795 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:49:59.505044 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-bde17d10-eb96-4d57-98bd-3316f8b140d3 req-6473d31e-3088-47f7-b1a5-264426297795 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:49:59.516028 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-bde17d10-eb96-4d57-98bd-3316f8b140d3 req-6473d31e-3088-47f7-b1a5-264426297795 service nova] Creating event network-changed:b6823ae7-fbf5-4aa7-b58d-9791661e2ad8 for instance eecc431d-c315-47ca-835b-6ea0a2ff168d on hv-cinder-86283 Oct 27 17:49:59.519424 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR oslo.messaging._drivers.impl_rabbit [req-bde17d10-eb96-4d57-98bd-3316f8b140d3 req-6473d31e-3088-47f7-b1a5-264426297795 service nova] [8e75be07-d86b-419c-a0d5-c7c4165f38ff] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 17:50:00.528556 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO oslo.messaging._drivers.impl_rabbit [req-bde17d10-eb96-4d57-98bd-3316f8b140d3 req-6473d31e-3088-47f7-b1a5-264426297795 service nova] [8e75be07-d86b-419c-a0d5-c7c4165f38ff] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 55304. Oct 27 17:50:00.532262 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-bde17d10-eb96-4d57-98bd-3316f8b140d3 req-6473d31e-3088-47f7-b1a5-264426297795 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.042072 Oct 27 17:50:00.532863 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 647/1266] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:51:49.469998 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:51:49.471212 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG dbcounter [-] [119046] Writing DB stats nova_cell1:SELECT=48 {{(pid=119046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:51:49.473164 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3117ccbe-c345-4204-afa1-6224d10893f7] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 27 17:51:49.473624 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_api:SELECT=22 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:51:49.474532 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 17:51:49.474675 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG dbcounter [-] [119047] Writing DB stats nova_cell1:SELECT=50 {{(pid=119047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 17:51:49.474774 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Thu Oct 27 17:51:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d (ip 10.222.0.36) !!! Oct 27 17:51:49.475881 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 17:51:49.476005 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Thu Oct 27 17:51:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 27 17:51:49.477410 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 17:51:49.477545 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Thu Oct 27 17:51:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 27 17:51:49.483218 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-74da6a9d-95c7-44b4-8006-a394a450b498 req-d413132d-4ce9-4bee-9e50-8bf36b675d7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eecc431d-c315-47ca-835b-6ea0a2ff168d", "tag": "b6823ae7-fbf5-4aa7-b58d-9791661e2ad8"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:51:49.489710 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-fced1a3d-151d-47e1-a6f6-ad77a9e7892e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:51:49.490441 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-fced1a3d-151d-47e1-a6f6-ad77a9e7892e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:51:49.495333 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-74da6a9d-95c7-44b4-8006-a394a450b498 req-d413132d-4ce9-4bee-9e50-8bf36b675d7f service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:49.495830 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-74da6a9d-95c7-44b4-8006-a394a450b498 req-d413132d-4ce9-4bee-9e50-8bf36b675d7f service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:49.496298 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-74da6a9d-95c7-44b4-8006-a394a450b498 req-d413132d-4ce9-4bee-9e50-8bf36b675d7f service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:49.500487 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fced1a3d-151d-47e1-a6f6-ad77a9e7892e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:49.500965 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fced1a3d-151d-47e1-a6f6-ad77a9e7892e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:49.501409 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fced1a3d-151d-47e1-a6f6-ad77a9e7892e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:49.502261 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fced1a3d-151d-47e1-a6f6-ad77a9e7892e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:49.502520 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fced1a3d-151d-47e1-a6f6-ad77a9e7892e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:49.502935 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-fced1a3d-151d-47e1-a6f6-ad77a9e7892e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:49.513425 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-74da6a9d-95c7-44b4-8006-a394a450b498 req-d413132d-4ce9-4bee-9e50-8bf36b675d7f service nova] Creating event network-changed:b6823ae7-fbf5-4aa7-b58d-9791661e2ad8 for instance eecc431d-c315-47ca-835b-6ea0a2ff168d on hv-cinder-86283 Oct 27 17:51:49.518857 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-74da6a9d-95c7-44b4-8006-a394a450b498 req-d413132d-4ce9-4bee-9e50-8bf36b675d7f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047807 Oct 27 17:51:49.519802 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 648/1267] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:51:49.535078 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-fced1a3d-151d-47e1-a6f6-ad77a9e7892e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Going to try to terminate instance {{(pid=119046) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:51:49.624683 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-fced1a3d-151d-47e1-a6f6-ad77a9e7892e tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 204 len: 0 microversion: 2.1 time: 0.156341 Oct 27 17:51:49.626005 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 620/1268] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:51:49 2022] DELETE /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:51:49.635069 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0673af5f-2bb6-4acb-917c-c509d7861b18 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:51:49.635959 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-0673af5f-2bb6-4acb-917c-c509d7861b18 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:51:49.642374 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0673af5f-2bb6-4acb-917c-c509d7861b18 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:49.642932 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0673af5f-2bb6-4acb-917c-c509d7861b18 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:49.643700 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0673af5f-2bb6-4acb-917c-c509d7861b18 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:49.644484 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0673af5f-2bb6-4acb-917c-c509d7861b18 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:49.644996 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0673af5f-2bb6-4acb-917c-c509d7861b18 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:49.645644 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0673af5f-2bb6-4acb-917c-c509d7861b18 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:49.784706 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-0673af5f-2bb6-4acb-917c-c509d7861b18 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:51:49.792656 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0673af5f-2bb6-4acb-917c-c509d7861b18 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1578 microversion: 2.1 time: 0.162509 Oct 27 17:51:49.793210 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 649/1269] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:51:49 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 17:51:50.816264 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-8cf43cda-c957-4dea-b1b6-d716a364247f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:51:50.816928 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-8cf43cda-c957-4dea-b1b6-d716a364247f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:51:50.823453 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cf43cda-c957-4dea-b1b6-d716a364247f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:50.823963 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cf43cda-c957-4dea-b1b6-d716a364247f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:50.824392 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cf43cda-c957-4dea-b1b6-d716a364247f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:50.825076 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cf43cda-c957-4dea-b1b6-d716a364247f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:50.825518 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cf43cda-c957-4dea-b1b6-d716a364247f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:50.825932 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-8cf43cda-c957-4dea-b1b6-d716a364247f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:51.029273 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-8cf43cda-c957-4dea-b1b6-d716a364247f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:51:51.036967 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-8cf43cda-c957-4dea-b1b6-d716a364247f tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1578 microversion: 2.1 time: 0.225133 Oct 27 17:51:51.037535 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 621/1270] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:51:50 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1578 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:51:51.960216 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-02683276-1cb0-4224-b5df-7b974e4f43ce req-b172502a-d401-44a9-800a-3087794d9441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecc431d-c315-47ca-835b-6ea0a2ff168d", "name": "network-vif-deleted", "tag": "b6823ae7-fbf5-4aa7-b58d-9791661e2ad8"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:51:51.976263 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO oslo.messaging._drivers.impl_rabbit [-] [3117ccbe-c345-4204-afa1-6224d10893f7] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 55362. Oct 27 17:51:51.981744 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-02683276-1cb0-4224-b5df-7b974e4f43ce req-b172502a-d401-44a9-800a-3087794d9441 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:51.982158 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-02683276-1cb0-4224-b5df-7b974e4f43ce req-b172502a-d401-44a9-800a-3087794d9441 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:51.982600 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-02683276-1cb0-4224-b5df-7b974e4f43ce req-b172502a-d401-44a9-800a-3087794d9441 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:51.996459 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-02683276-1cb0-4224-b5df-7b974e4f43ce req-b172502a-d401-44a9-800a-3087794d9441 service nova] Creating event network-vif-deleted:b6823ae7-fbf5-4aa7-b58d-9791661e2ad8 for instance eecc431d-c315-47ca-835b-6ea0a2ff168d on hv-cinder-86283 Oct 27 17:51:52.001500 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-02683276-1cb0-4224-b5df-7b974e4f43ce req-b172502a-d401-44a9-800a-3087794d9441 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045138 Oct 27 17:51:52.002086 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 650/1271] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:51:52.061341 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6eec2cd4-33b0-4a5a-8793-3495925f3193 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:51:52.062028 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6eec2cd4-33b0-4a5a-8793-3495925f3193 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:51:52.068520 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6eec2cd4-33b0-4a5a-8793-3495925f3193 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:52.069006 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6eec2cd4-33b0-4a5a-8793-3495925f3193 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:52.069445 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6eec2cd4-33b0-4a5a-8793-3495925f3193 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:52.070140 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6eec2cd4-33b0-4a5a-8793-3495925f3193 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:52.070596 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6eec2cd4-33b0-4a5a-8793-3495925f3193 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:52.071021 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6eec2cd4-33b0-4a5a-8793-3495925f3193 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:52.132099 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-6eec2cd4-33b0-4a5a-8793-3495925f3193 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:51:52.139752 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6eec2cd4-33b0-4a5a-8793-3495925f3193 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 200 len: 1225 microversion: 2.1 time: 0.082402 Oct 27 17:51:52.140321 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 622/1272] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:51:52 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:51:53.162799 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0058621e-11ef-48a5-8006-2c92f91fe35b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:51:53.163419 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-0058621e-11ef-48a5-8006-2c92f91fe35b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: eecc431d-c315-47ca-835b-6ea0a2ff168d] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:51:53.170296 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0058621e-11ef-48a5-8006-2c92f91fe35b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:53.170783 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0058621e-11ef-48a5-8006-2c92f91fe35b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:53.171221 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0058621e-11ef-48a5-8006-2c92f91fe35b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:53.171949 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0058621e-11ef-48a5-8006-2c92f91fe35b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:53.172433 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0058621e-11ef-48a5-8006-2c92f91fe35b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:53.172856 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0058621e-11ef-48a5-8006-2c92f91fe35b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:53.186587 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-0058621e-11ef-48a5-8006-2c92f91fe35b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] HTTP exception thrown: Instance eecc431d-c315-47ca-835b-6ea0a2ff168d could not be found. Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0058621e-11ef-48a5-8006-2c92f91fe35b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Request method failure captured: Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d HTTP/1.1 Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsNbCv2S6QezRIc42LiTTWHJMkHp3PL1swC9021AC6L0LaFVsvYLj3GztS3MQcZvqjsouw2zSS0tdfKGP5rAHKrKJXPPcZUhp2UU_wYNhBk90CoMKVNrx81OAHSEEEJrcqiqiIpVKxlaHHrEKxj4DTjAfYCfW_XboZYyexLlyeZVHzA Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: e62c12b7398343648a02ef5c64cda2b1 Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-TestVolumeBootPattern-1346887961 Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:51:53.188244 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:51:53.190043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e62c12b7398343648a02ef5c64cda2b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e62c12b7398343648a02ef5c64cda2b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e62c12b7398343648a02ef5c64cda2b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e62c12b7398343648a02ef5c64cda2b1"}]}] Oct 27 17:51:53.190043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-TestVolumeBootPattern-1346887961 Oct 27 17:51:53.190043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: e62c12b7398343648a02ef5c64cda2b1 Oct 27 17:51:53.190043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-TestVolumeBootPattern-1346887961 Oct 27 17:51:53.190043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-TestVolumeBootPattern-1346887961-project Oct 27 17:51:53.190043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:51:53.190043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:51:53.190043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 7aa8ef56dea147fe9594ac6ae812aebb Oct 27 17:51:53.190043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-TestVolumeBootPattern-1346887961-project Oct 27 17:51:53.190043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:51:53.190043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance eecc431d-c315-47ca-835b-6ea0a2ff168d could not be found. Oct 27 17:51:53.190043 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': 'eecc431d-c315-47ca-835b-6ea0a2ff168d'} Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eecc431d-c315-47ca-835b-6ea0a2ff168d could not be found. Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:51:53.191676 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eecc431d-c315-47ca-835b-6ea0a2ff168d could not be found. Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eecc431d-c315-47ca-835b-6ea0a2ff168d could not be found. Oct 27 17:51:53.193559 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:51:53.195323 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0058621e-11ef-48a5-8006-2c92f91fe35b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Returning 404 to user: Instance eecc431d-c315-47ca-835b-6ea0a2ff168d could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:51:53.195323 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0058621e-11ef-48a5-8006-2c92f91fe35b tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d" status: 404 len: 111 microversion: 2.1 time: 0.031190 Oct 27 17:51:53.195323 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 651/1273] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:51:53 2022] GET /compute/v2.1/servers/eecc431d-c315-47ca-835b-6ea0a2ff168d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:51:56.238424 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-44bf41e3-bf99-4b40-bfc6-c6e77d5c61fe tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:51:56.239480 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-44bf41e3-bf99-4b40-bfc6-c6e77d5c61fe tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:51:56.240193 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-14c779fd-8e48-4d59-b891-14853d6efd75 req-374cd8d0-e196-4080-9f49-a79530cddef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b", "tag": "c8314d68-3215-42b5-a8e1-79d5b0f4dba7"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:51:56.246216 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44bf41e3-bf99-4b40-bfc6-c6e77d5c61fe tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:56.246928 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44bf41e3-bf99-4b40-bfc6-c6e77d5c61fe tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:56.247441 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44bf41e3-bf99-4b40-bfc6-c6e77d5c61fe tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:56.248169 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44bf41e3-bf99-4b40-bfc6-c6e77d5c61fe tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:56.248617 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44bf41e3-bf99-4b40-bfc6-c6e77d5c61fe tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:56.249325 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-44bf41e3-bf99-4b40-bfc6-c6e77d5c61fe tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:56.250321 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-14c779fd-8e48-4d59-b891-14853d6efd75 req-374cd8d0-e196-4080-9f49-a79530cddef8 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:56.250871 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-14c779fd-8e48-4d59-b891-14853d6efd75 req-374cd8d0-e196-4080-9f49-a79530cddef8 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:56.251389 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-14c779fd-8e48-4d59-b891-14853d6efd75 req-374cd8d0-e196-4080-9f49-a79530cddef8 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:56.263211 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-14c779fd-8e48-4d59-b891-14853d6efd75 req-374cd8d0-e196-4080-9f49-a79530cddef8 service nova] Creating event network-changed:c8314d68-3215-42b5-a8e1-79d5b0f4dba7 for instance 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b on hv-cinder-86283 Oct 27 17:51:56.268947 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-14c779fd-8e48-4d59-b891-14853d6efd75 req-374cd8d0-e196-4080-9f49-a79530cddef8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032515 Oct 27 17:51:56.270068 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 652/1274] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 17:51:56.276315 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-44bf41e3-bf99-4b40-bfc6-c6e77d5c61fe tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Going to try to terminate instance {{(pid=119046) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 17:51:56.363315 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-44bf41e3-bf99-4b40-bfc6-c6e77d5c61fe tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 204 len: 0 microversion: 2.1 time: 0.128792 Oct 27 17:51:56.364401 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 623/1275] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:51:56 2022] DELETE /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 17:51:56.374347 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-710729ee-3c4f-4420-a6d5-1f48467db2fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:51:56.375052 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-710729ee-3c4f-4420-a6d5-1f48467db2fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:51:56.381594 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-710729ee-3c4f-4420-a6d5-1f48467db2fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:56.382088 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-710729ee-3c4f-4420-a6d5-1f48467db2fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:56.382528 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-710729ee-3c4f-4420-a6d5-1f48467db2fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:56.383234 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-710729ee-3c4f-4420-a6d5-1f48467db2fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:56.383694 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-710729ee-3c4f-4420-a6d5-1f48467db2fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:56.384184 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-710729ee-3c4f-4420-a6d5-1f48467db2fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:56.523154 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.policy [None req-710729ee-3c4f-4420-a6d5-1f48467db2fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119047) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:51:56.531580 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-710729ee-3c4f-4420-a6d5-1f48467db2fc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1579 microversion: 2.1 time: 0.161372 Oct 27 17:51:56.532511 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 653/1276] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:51:56 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:51:57.555020 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-6834ed53-42d3-4008-9135-70bb630941a4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:51:57.555823 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-6834ed53-42d3-4008-9135-70bb630941a4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:51:57.562706 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6834ed53-42d3-4008-9135-70bb630941a4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:57.563176 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6834ed53-42d3-4008-9135-70bb630941a4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:57.563605 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6834ed53-42d3-4008-9135-70bb630941a4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:57.564317 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6834ed53-42d3-4008-9135-70bb630941a4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:57.564759 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6834ed53-42d3-4008-9135-70bb630941a4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:57.565174 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-6834ed53-42d3-4008-9135-70bb630941a4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:57.762180 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-6834ed53-42d3-4008-9135-70bb630941a4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:51:57.770770 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-6834ed53-42d3-4008-9135-70bb630941a4 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1579 microversion: 2.1 time: 0.219993 Oct 27 17:51:57.771330 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 624/1277] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:51:57 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1579 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:51:58.576150 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [req-fac9da50-4a02-417d-b036-387dcba54386 req-f3175efb-e71e-4fdc-bec3-cb0627d11b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b", "name": "network-vif-deleted", "tag": "c8314d68-3215-42b5-a8e1-79d5b0f4dba7"}]} {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 17:51:58.587953 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-fac9da50-4a02-417d-b036-387dcba54386 req-f3175efb-e71e-4fdc-bec3-cb0627d11b36 service nova] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:58.588427 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-fac9da50-4a02-417d-b036-387dcba54386 req-f3175efb-e71e-4fdc-bec3-cb0627d11b36 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:58.588849 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [req-fac9da50-4a02-417d-b036-387dcba54386 req-f3175efb-e71e-4fdc-bec3-cb0627d11b36 service nova] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:58.599873 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.compute.server_external_events [req-fac9da50-4a02-417d-b036-387dcba54386 req-f3175efb-e71e-4fdc-bec3-cb0627d11b36 service nova] Creating event network-vif-deleted:c8314d68-3215-42b5-a8e1-79d5b0f4dba7 for instance 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b on hv-cinder-86283 Oct 27 17:51:58.605904 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [req-fac9da50-4a02-417d-b036-387dcba54386 req-f3175efb-e71e-4fdc-bec3-cb0627d11b36 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033956 Oct 27 17:51:58.606503 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 654/1278] 10.222.0.36 () {64 vars in 1317 bytes} [Thu Oct 27 17:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 17:51:58.794834 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-289a3758-94cd-4416-924a-648ec183a778 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:51:58.795403 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-289a3758-94cd-4416-924a-648ec183a778 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:51:58.801803 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-289a3758-94cd-4416-924a-648ec183a778 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:58.802287 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-289a3758-94cd-4416-924a-648ec183a778 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:58.802726 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-289a3758-94cd-4416-924a-648ec183a778 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:58.803414 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-289a3758-94cd-4416-924a-648ec183a778 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:58.803910 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-289a3758-94cd-4416-924a-648ec183a778 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:58.804337 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-289a3758-94cd-4416-924a-648ec183a778 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:58.870656 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.policy [None req-289a3758-94cd-4416-924a-648ec183a778 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aa8ef56dea147fe9594ac6ae812aebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62c12b7398343648a02ef5c64cda2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119046) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 17:51:58.879270 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-289a3758-94cd-4416-924a-648ec183a778 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 200 len: 1226 microversion: 2.1 time: 0.088737 Oct 27 17:51:58.879878 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 625/1279] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:51:58 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 17:51:59.903509 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0b8b99ee-2507-415c-a899-93a833db89cc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:51:59.904149 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-0b8b99ee-2507-415c-a899-93a833db89cc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:51:59.910274 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0b8b99ee-2507-415c-a899-93a833db89cc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:59.910752 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0b8b99ee-2507-415c-a899-93a833db89cc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:59.911181 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0b8b99ee-2507-415c-a899-93a833db89cc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:59.911934 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0b8b99ee-2507-415c-a899-93a833db89cc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:51:59.912387 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0b8b99ee-2507-415c-a899-93a833db89cc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:51:59.912804 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-0b8b99ee-2507-415c-a899-93a833db89cc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:51:59.925790 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-0b8b99ee-2507-415c-a899-93a833db89cc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] HTTP exception thrown: Instance 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b could not be found. Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0b8b99ee-2507-415c-a899-93a833db89cc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Request method failure captured: Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b HTTP/1.1 Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsNbCv2S6QezRIc42LiTTWHJMkHp3PL1swC9021AC6L0LaFVsvYLj3GztS3MQcZvqjsouw2zSS0tdfKGP5rAHKrKJXPPcZUhp2UU_wYNhBk90CoMKVNrx81OAHSEEEJrcqiqiIpVKxlaHHrEKxj4DTjAfYCfW_XboZYyexLlyeZVHzA Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: e62c12b7398343648a02ef5c64cda2b1 Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-TestVolumeBootPattern-1346887961 Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:51:59.927376 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:51:59.929123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e62c12b7398343648a02ef5c64cda2b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e62c12b7398343648a02ef5c64cda2b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e62c12b7398343648a02ef5c64cda2b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e62c12b7398343648a02ef5c64cda2b1"}]}] Oct 27 17:51:59.929123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-TestVolumeBootPattern-1346887961 Oct 27 17:51:59.929123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: e62c12b7398343648a02ef5c64cda2b1 Oct 27 17:51:59.929123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-TestVolumeBootPattern-1346887961 Oct 27 17:51:59.929123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-TestVolumeBootPattern-1346887961-project Oct 27 17:51:59.929123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:51:59.929123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:51:59.929123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 7aa8ef56dea147fe9594ac6ae812aebb Oct 27 17:51:59.929123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-TestVolumeBootPattern-1346887961-project Oct 27 17:51:59.929123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:51:59.929123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b could not be found. Oct 27 17:51:59.929123 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': '7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b'} Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b could not be found. Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:51:59.930209 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b could not be found. Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b could not be found. Oct 27 17:51:59.932378 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:51:59.934030 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-0b8b99ee-2507-415c-a899-93a833db89cc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Returning 404 to user: Instance 7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:51:59.934030 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-0b8b99ee-2507-415c-a899-93a833db89cc tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b" status: 404 len: 111 microversion: 2.1 time: 0.030145 Oct 27 17:51:59.934030 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 655/1280] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:51:59 2022] GET /compute/v2.1/servers/7a23fbc7-0b00-4f94-b77d-4e9dc21a9d2b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:52:00.366031 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ea1a7b47-1019-4454-a335-0002bca929fa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:52:00.366530 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.compute.api [None req-ea1a7b47-1019-4454-a335-0002bca929fa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119046) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:52:00.373771 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ea1a7b47-1019-4454-a335-0002bca929fa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:52:00.374253 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ea1a7b47-1019-4454-a335-0002bca929fa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:52:00.374685 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ea1a7b47-1019-4454-a335-0002bca929fa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:52:00.375372 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ea1a7b47-1019-4454-a335-0002bca929fa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:52:00.375856 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ea1a7b47-1019-4454-a335-0002bca929fa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:52:00.376286 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG oslo_concurrency.lockutils [None req-ea1a7b47-1019-4454-a335-0002bca929fa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:52:00.391934 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.wsgi [None req-ea1a7b47-1019-4454-a335-0002bca929fa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] HTTP exception thrown: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ea1a7b47-1019-4454-a335-0002bca929fa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Request method failure captured: Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: request: DELETE /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e HTTP/1.1 Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept: application/json Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Accept-Encoding: identity Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Connection: close Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Length: 0 Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Content-Type: application/json Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Host: 10.222.0.36 Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: Openstack-System-Scope: None Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: User-Agent: python-urllib3/1.26.12 Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Auth-Token: gAAAAABjWsNbCv2S6QezRIc42LiTTWHJMkHp3PL1swC9021AC6L0LaFVsvYLj3GztS3MQcZvqjsouw2zSS0tdfKGP5rAHKrKJXPPcZUhp2UU_wYNhBk90CoMKVNrx81OAHSEEEJrcqiqiIpVKxlaHHrEKxj4DTjAfYCfW_XboZYyexLlyeZVHzA Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Id: None Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Domain-Name: None Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Identity-Status: Confirmed Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Is-Admin-Project: True Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Id: default Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Domain-Name: Default Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Id: e62c12b7398343648a02ef5c64cda2b1 Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Project-Name: tempest-TestVolumeBootPattern-1346887961 Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Role: reader,member Oct 27 17:52:00.393579 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Roles: reader,member Oct 27 17:52:00.395375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e62c12b7398343648a02ef5c64cda2b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e62c12b7398343648a02ef5c64cda2b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e62c12b7398343648a02ef5c64cda2b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e62c12b7398343648a02ef5c64cda2b1"}]}] Oct 27 17:52:00.395375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant: tempest-TestVolumeBootPattern-1346887961 Oct 27 17:52:00.395375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Id: e62c12b7398343648a02ef5c64cda2b1 Oct 27 17:52:00.395375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-Tenant-Name: tempest-TestVolumeBootPattern-1346887961 Oct 27 17:52:00.395375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User: tempest-TestVolumeBootPattern-1346887961-project Oct 27 17:52:00.395375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Id: default Oct 27 17:52:00.395375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Domain-Name: Default Oct 27 17:52:00.395375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Id: 7aa8ef56dea147fe9594ac6ae812aebb Oct 27 17:52:00.395375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: X-User-Name: tempest-TestVolumeBootPattern-1346887961-project Oct 27 17:52:00.395375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: method: > Oct 27 17:52:00.395375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: exception: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. Oct 27 17:52:00.395375 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: action_args: {'id': 'cd62978f-8c7f-4d02-8742-98a3a867dd4e'} Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:52:00.396425 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. Oct 27 17:52:00.398023 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: ERROR nova.api.openstack.wsgi Oct 27 17:52:00.399667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ea1a7b47-1019-4454-a335-0002bca929fa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Returning 404 to user: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. {{(pid=119046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:52:00.399667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ea1a7b47-1019-4454-a335-0002bca929fa tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 404 len: 111 microversion: 2.1 time: 0.032790 Oct 27 17:52:00.399667 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 626/1281] 10.222.0.36 () {58 vars in 1239 bytes} [Thu Oct 27 17:52:00 2022] DELETE /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:52:00.404551 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a68a0027-1c47-4f96-91d8-7c40d53e8c11 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '>' {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:52:00.405166 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.compute.api [None req-a68a0027-1c47-4f96-91d8-7c40d53e8c11 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] [instance: cd62978f-8c7f-4d02-8742-98a3a867dd4e] Fetching instance by UUID {{(pid=119047) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 17:52:00.411110 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a68a0027-1c47-4f96-91d8-7c40d53e8c11 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:52:00.411591 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a68a0027-1c47-4f96-91d8-7c40d53e8c11 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:52:00.412058 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a68a0027-1c47-4f96-91d8-7c40d53e8c11 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:52:00.412746 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a68a0027-1c47-4f96-91d8-7c40d53e8c11 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Acquiring lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 17:52:00.413199 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a68a0027-1c47-4f96-91d8-7c40d53e8c11 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 17:52:00.413621 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG oslo_concurrency.lockutils [None req-a68a0027-1c47-4f96-91d8-7c40d53e8c11 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Lock "b9e2082a-7e53-41e4-a8a5-142e829788d7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 17:52:00.427702 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.wsgi [None req-a68a0027-1c47-4f96-91d8-7c40d53e8c11 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] HTTP exception thrown: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a68a0027-1c47-4f96-91d8-7c40d53e8c11 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Request method failure captured: Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: request: GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e HTTP/1.1 Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept: application/json Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Accept-Encoding: identity Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Connection: close Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Length: 0 Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Content-Type: application/json Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Host: 10.222.0.36 Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: Openstack-System-Scope: None Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: User-Agent: python-urllib3/1.26.12 Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Auth-Token: gAAAAABjWsNbCv2S6QezRIc42LiTTWHJMkHp3PL1swC9021AC6L0LaFVsvYLj3GztS3MQcZvqjsouw2zSS0tdfKGP5rAHKrKJXPPcZUhp2UU_wYNhBk90CoMKVNrx81OAHSEEEJrcqiqiIpVKxlaHHrEKxj4DTjAfYCfW_XboZYyexLlyeZVHzA Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Id: None Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Domain-Name: None Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Identity-Status: Confirmed Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Is-Admin-Project: True Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Id: default Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Domain-Name: Default Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Id: e62c12b7398343648a02ef5c64cda2b1 Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Project-Name: tempest-TestVolumeBootPattern-1346887961 Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Role: reader,member Oct 27 17:52:00.429225 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Roles: reader,member Oct 27 17:52:00.431468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e62c12b7398343648a02ef5c64cda2b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e62c12b7398343648a02ef5c64cda2b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e62c12b7398343648a02ef5c64cda2b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e62c12b7398343648a02ef5c64cda2b1"}]}] Oct 27 17:52:00.431468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant: tempest-TestVolumeBootPattern-1346887961 Oct 27 17:52:00.431468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Id: e62c12b7398343648a02ef5c64cda2b1 Oct 27 17:52:00.431468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-Tenant-Name: tempest-TestVolumeBootPattern-1346887961 Oct 27 17:52:00.431468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User: tempest-TestVolumeBootPattern-1346887961-project Oct 27 17:52:00.431468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Id: default Oct 27 17:52:00.431468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Domain-Name: Default Oct 27 17:52:00.431468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Id: 7aa8ef56dea147fe9594ac6ae812aebb Oct 27 17:52:00.431468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: X-User-Name: tempest-TestVolumeBootPattern-1346887961-project Oct 27 17:52:00.431468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: method: > Oct 27 17:52:00.431468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: exception: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. Oct 27 17:52:00.431468 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: action_args: {'id': 'cd62978f-8c7f-4d02-8742-98a3a867dd4e'} Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: {{(pid=119047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 17:52:00.432467 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. Oct 27 17:52:00.434048 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: ERROR nova.api.openstack.wsgi Oct 27 17:52:00.435451 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: DEBUG nova.api.openstack.wsgi [None req-a68a0027-1c47-4f96-91d8-7c40d53e8c11 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Returning 404 to user: Instance cd62978f-8c7f-4d02-8742-98a3a867dd4e could not be found. {{(pid=119047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 17:52:00.435451 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: INFO nova.api.openstack.requestlog [None req-a68a0027-1c47-4f96-91d8-7c40d53e8c11 tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e" status: 404 len: 111 microversion: 2.1 time: 0.030697 Oct 27 17:52:00.435451 dv-cinder-862831-1-iscsi devstack@n-api.service[119047]: [pid: 119047|app: 0|req: 656/1282] 10.222.0.36 () {58 vars in 1236 bytes} [Thu Oct 27 17:52:00 2022] GET /compute/v2.1/servers/cd62978f-8c7f-4d02-8742-98a3a867dd4e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 17:52:01.724487 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: DEBUG nova.api.openstack.wsgi [None req-ce5f2cc3-0c46-498f-8673-d75615496eed tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] Calling method '.version_select at 0x7f07887d9ee0>' {{(pid=119046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 17:52:01.747888 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: INFO nova.api.openstack.requestlog [None req-ce5f2cc3-0c46-498f-8673-d75615496eed tempest-TestVolumeBootPattern-1346887961 tempest-TestVolumeBootPattern-1346887961-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1501870066" status: 202 len: 0 microversion: 2.1 time: 0.027244 Oct 27 17:52:01.748459 dv-cinder-862831-1-iscsi devstack@n-api.service[119046]: [pid: 119046|app: 0|req: 627/1283] 10.222.0.36 () {58 vars in 1263 bytes} [Thu Oct 27 17:52:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1501870066 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)